Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30036 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37186 originally caused by: Started by upstream project "master-osmo-iuh" build number 12848 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29260 originally caused by: Started by upstream project "master-osmo-msc" build number 34204 originally caused by: Started by upstream project "master-osmo-iuh" build number 12848 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17653 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7504 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6678 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8697 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8943 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2948 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29260 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5150 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30036 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4674 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12965 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9238 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4696 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8035 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5189 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5531 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3907 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins3485275748511944232.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-09 12:45:46 + trial_dir_prefix=trial- + rm -rf trial-2359 trial-2359-bin.tgz trial-2359-run.tgz + trial_dir=trial-2360 + mkdir -p trial-2360 + mv open5gs.build-8.tgz osmo-bsc.build-17653.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6678.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2948.tgz osmo-mgw.build-8943.tgz osmo-msc.build-29260.tgz osmo-nitb.build-12965.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30036.tgz osmo-stp.build-9238.tgz osmo-trx.build-4674.tgz osmocom-bb.build-4696.tgz srslte.build-19.tgz trial-2360 + cat open5gs.build-8.md5 osmo-bsc.build-17653.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6678.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2948.md5 osmo-mgw.build-8943.md5 osmo-msc.build-29260.md5 osmo-nitb.build-12965.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30036.md5 osmo-stp.build-9238.md5 osmo-trx.build-4674.md5 osmocom-bb.build-4696.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17653.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6678.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2948.md5 osmo-mgw.build-8943.md5 osmo-msc.build-29260.md5 osmo-nitb.build-12965.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30036.md5 osmo-stp.build-9238.md5 osmo-trx.build-4674.md5 osmocom-bb.build-4696.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2360 combinations: None trial: 'trial-2360' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2360 -------------------------------------------------------------------------------------------- 12:45:57.890913 tst trial-2360: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/log --------------------------------------------------------------------- trial-2360 nitb_sms:sysmo --------------------------------------------------------------------- 12:48:08.570717 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:48:08.574599 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 12:48:08.596455 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 12:48:08.603785 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 12:48:08.657692 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 12:48:08.678960 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 12:48:08.686288 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 12:48:09.228023 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 12:48:09.234091 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 12:48:09.245890 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 12:48:09.630221 tst mo_mt_sms.py: using LAC 21564 12:48:09.875015 tst mo_mt_sms.py: using RAC 144 12:48:09.996023 tst mo_mt_sms.py: using CellId 21564 12:48:10.117574 tst mo_mt_sms.py: using BVCI 21565 12:48:10.233534 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 12:48:10.413114 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 12:48:10.532940 tst mo_mt_sms.py:9: start nitb and bts... 12:48:10.750026 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:48:13.100032 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6823): Launched 12:48:13.426038 run osmo-nitb_10.42.42.2(pid=6824): Launched 12:48:13.603213 run osmo-nitb_10.42.42.2(pid=6824): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6824)] 12:48:13.736296 run osmo-nitb_10.42.42.2(pid=6824): stdout: | (launched: 2022-12-09_12:48:13.365756) 12:48:13.870946 run osmo-nitb_10.42.42.2(pid=6824): stderr: | (launched: 2022-12-09_12:48:13.413887) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:48:14.005684 run osmo-nitb_10.42.42.2(pid=6824): stdout: | (launched: 2022-12-09_12:48:13.365756) 12:48:14.134340 run osmo-nitb_10.42.42.2(pid=6824): stderr: | (launched: 2022-12-09_12:48:13.413887) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:48:14.287794 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=6824): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6824) [trial-2360↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6824)] [trial-2360↪nitb_sms:sysmo↪mo_mt_sms.py:11] 12:48:14.296796 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 12:48:14.303934 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6823): Terminating (SIGTERM) 12:48:14.515639 --- ParallelTerminationStrategy: PID 6823 died... 12:48:14.537290 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6823): Terminated: ok {rc=0} 12:48:14.626607 bus /sierra_3: Setting Powered False 12:48:15.728006 bus /sierra_3: Setting Powered False 12:48:16.847521 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 sms:sysmo --------------------------------------------------------------------- 12:48:18.029803 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:48:18.033729 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 12:48:18.054323 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 12:48:18.080898 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 12:48:18.134339 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 12:48:18.155707 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 12:48:18.182341 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 12:48:18.727061 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 sms:sysmo mo_mt_sms.py ---------------------------------------------- 12:48:18.731924 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:48:18.742590 tst sms:sysmo: Using 1 x bts (candidates: 1) 12:48:18.777436 tst mo_mt_sms.py: using LAC 21565 12:48:18.896371 tst mo_mt_sms.py: using RAC 145 12:48:19.016676 tst mo_mt_sms.py: using CellId 21565 12:48:19.139512 tst mo_mt_sms.py: using BVCI 21566 12:48:19.250154 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:48:19.260760 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:48:19.271362 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:48:19.281856 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:48:19.292282 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:48:19.302864 tst sms:sysmo: Using 1 x modem (candidates: 2) 12:48:19.414614 tst sms:sysmo: Using 1 x modem (candidates: 2) 12:48:19.536879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:21.308768 run create_hlr_db(pid=6828): Launched 12:48:21.435823 bus /sierra_2: Setting Powered False 12:48:22.499953 run create_hlr_db(pid=6828): Terminated: ok {rc=0} 12:48:22.935796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6830): Launched 12:48:23.241549 run osmo-hlr_10.42.42.2(pid=6831): Launched 12:48:23.358571 run osmo-stp_10.42.42.5: Starting osmo-stp 12:48:25.815169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6833): Launched 12:48:26.121082 run osmo-stp_10.42.42.5(pid=6834): Launched 12:48:26.236443 run osmo-msc_10.42.42.6: Starting osmo-msc 12:48:31.555929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6836): Launched 12:48:31.957483 run osmo-msc_10.42.42.6(pid=6837): Launched 12:48:32.272923 run osmo-stp_10.42.42.5(pid=6834): ERR: Terminated: ERROR {rc=1} [trial-2360↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6834)] 12:48:32.400834 run osmo-stp_10.42.42.5(pid=6834): stdout: | (launched: 2022-12-09_12:48:26.063806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:32.529295 run osmo-stp_10.42.42.5(pid=6834): stderr: | 20221209124826238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124826238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124826238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124826239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124826239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124826239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124826239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:32.655862 run osmo-stp_10.42.42.5(pid=6834): stdout: | (launched: 2022-12-09_12:48:26.063806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:32.775789 run osmo-stp_10.42.42.5(pid=6834): stderr: | 20221209124826238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124826238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124826238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124826239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124826239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124826239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124826239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:32.919402 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=6834): Process ended prematurely: osmo-stp_10.42.42.5(pid=6834) [trial-2360↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6834)] [trial-2360↪sms:sysmo↪mo_mt_sms.py:16] 12:48:32.927787 tst mo_mt_sms.py:16: Test FAILED (14.2 sec) 12:48:32.953908 run osmo-hlr_10.42.42.2(pid=6831): ERR: Terminated: ERROR {rc=237} [trial-2360↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6831)] 12:48:33.002041 run osmo-hlr_10.42.42.2(pid=6831): stdout: | (launched: 2022-12-09_12:48:23.184111) 12:48:33.052192 run osmo-hlr_10.42.42.2(pid=6831): stderr: | 20221209124823364 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124823364 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124823364 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124823364 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124823364 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124823364 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124823376 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124823385 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124823385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124823385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:33.121374 run osmo-msc_10.42.42.6(pid=6837): ERR: Terminated: ERROR {rc=2} [trial-2360↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6837)] 12:48:33.169387 run osmo-msc_10.42.42.6(pid=6837): stdout: | (launched: 2022-12-09_12:48:31.894992) 12:48:33.218795 run osmo-msc_10.42.42.6(pid=6837): stderr: | 20221209124832316 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124832316 DLGLOBAL DEBUG validating counter group 0x7f07139cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124832316 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124832316 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124832317 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124832317 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124832319 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124832319 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124832319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124832319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:48:33.268769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6830): Terminating (SIGTERM) 12:48:33.308836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6833): Terminating (SIGTERM) 12:48:33.349166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6836): Terminating (SIGTERM) 12:48:33.390796 --- ParallelTerminationStrategy: PID 6830 died... 12:48:33.410292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6830): Terminated: ok {rc=0} 12:48:33.455390 --- ParallelTerminationStrategy: PID 6833 died... 12:48:33.474402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6833): Terminated: ok {rc=0} 12:48:33.519176 --- ParallelTerminationStrategy: PID 6836 died... 12:48:33.538182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6836): Terminated: ok {rc=0} 12:48:33.625291 bus /sierra_3: Setting Powered False 12:48:34.726606 bus /sierra_3: Setting Powered False 12:48:35.843512 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_ussd:sysmo --------------------------------------------------------------------- 12:48:37.058202 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:48:37.061793 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 12:48:37.083086 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 12:48:37.090276 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 12:48:37.125232 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 12:48:37.146808 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 12:48:37.154413 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 12:48:37.674343 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2360 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 12:48:37.679929 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 12:48:37.691310 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 12:48:37.727162 tst assert_extension.py: using LAC 21566 12:48:37.854736 tst assert_extension.py: using RAC 146 12:48:37.983121 tst assert_extension.py: using CellId 21566 12:48:38.112357 tst assert_extension.py: using BVCI 21567 12:48:38.230353 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 12:48:38.344530 tst assert_extension.py:10: start nitb and bts... 12:48:38.550169 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:48:39.171450 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6842): Launched 12:48:39.477613 run osmo-nitb_10.42.42.2(pid=6843): Launched 12:48:39.644918 run osmo-nitb_10.42.42.2(pid=6843): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6843)] 12:48:39.780256 run osmo-nitb_10.42.42.2(pid=6843): stdout: | (launched: 2022-12-09_12:48:39.419680) 12:48:39.917722 run osmo-nitb_10.42.42.2(pid=6843): stderr: | (launched: 2022-12-09_12:48:39.464588) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:48:40.054855 run osmo-nitb_10.42.42.2(pid=6843): stdout: | (launched: 2022-12-09_12:48:39.419680) 12:48:40.186658 run osmo-nitb_10.42.42.2(pid=6843): stderr: | (launched: 2022-12-09_12:48:39.464588) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=6843): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6843) [trial-2360↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6843)] 12:48:40.591771 tst osmo-nitb_10.42.42.2(pid=6843): stdout: | (launched: 2022-12-09_12:48:39.419680) 12:48:40.714647 tst osmo-nitb_10.42.42.2(pid=6843): stderr: | (launched: 2022-12-09_12:48:39.464588) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:48:40.858702 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=6843): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6843) [trial-2360↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6843)] [trial-2360↪nitb_ussd:sysmo↪assert_extension.py:12] 12:48:40.867064 tst assert_extension.py:12: Test FAILED (3.2 sec) 12:48:40.873936 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6842): Terminating (SIGTERM) 12:48:41.082673 --- ParallelTerminationStrategy: PID 6842 died... 12:48:41.104104 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=6842): Terminated: ok {rc=0} 12:48:41.189863 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 ussd:sysmo --------------------------------------------------------------------- 12:48:42.357148 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:48:42.361517 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 12:48:42.382897 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 12:48:42.409631 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 12:48:42.444895 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 12:48:42.465541 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 12:48:42.491548 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 12:48:43.020296 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2360 ussd:sysmo assert_extension.py ---------------------------------------------- 12:48:43.025537 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:48:43.036221 tst ussd:sysmo: Using 1 x bts (candidates: 1) 12:48:43.071804 tst assert_extension.py: using LAC 21567 12:48:43.202006 tst assert_extension.py: using RAC 147 12:48:43.321827 tst assert_extension.py: using CellId 21567 12:48:43.440920 tst assert_extension.py: using BVCI 21568 12:48:43.551018 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:48:43.561697 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:48:43.573976 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:48:43.587745 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:48:43.599720 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:48:43.613449 tst ussd:sysmo: Using 1 x modem (candidates: 1) 12:48:43.736358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:44.207598 run create_hlr_db(pid=6847): Launched 12:48:44.333194 bus /sierra_2: Setting Powered False 12:48:45.394088 run create_hlr_db(pid=6847): Terminated: ok {rc=0} 12:48:45.849720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6849): Launched 12:48:46.199572 run osmo-hlr_10.42.42.2(pid=6850): Launched 12:48:46.431952 run osmo-stp_10.42.42.5: Starting osmo-stp 12:48:47.129635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6852): Launched 12:48:47.442970 run osmo-stp_10.42.42.5(pid=6853): Launched 12:48:47.559941 run osmo-msc_10.42.42.6: Starting osmo-msc 12:48:48.107086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6855): Launched 12:48:48.412426 run osmo-msc_10.42.42.6(pid=6856): Launched 12:48:48.582717 run osmo-stp_10.42.42.5(pid=6853): ERR: Terminated: ERROR {rc=1} [trial-2360↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6853)] 12:48:48.711142 run osmo-stp_10.42.42.5(pid=6853): stdout: | (launched: 2022-12-09_12:48:47.385291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:48.839700 run osmo-stp_10.42.42.5(pid=6853): stderr: | 20221209124847559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124847559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124847559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124847560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124847562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124847562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124847562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:48.966358 run osmo-stp_10.42.42.5(pid=6853): stdout: | (launched: 2022-12-09_12:48:47.385291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:49.086763 run osmo-stp_10.42.42.5(pid=6853): stderr: | 20221209124847559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124847559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124847559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124847560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124847562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124847562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124847562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:49.231627 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=6853): Process ended prematurely: osmo-stp_10.42.42.5(pid=6853) [trial-2360↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6853)] [trial-2360↪ussd:sysmo↪assert_extension.py:17] 12:48:49.239974 tst assert_extension.py:17: Test FAILED (6.2 sec) 12:48:49.265963 run osmo-hlr_10.42.42.2(pid=6850): ERR: Terminated: ERROR {rc=237} [trial-2360↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6850)] 12:48:49.314097 run osmo-hlr_10.42.42.2(pid=6850): stdout: | (launched: 2022-12-09_12:48:46.141304) 12:48:49.364063 run osmo-hlr_10.42.42.2(pid=6850): stderr: | 20221209124846484 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124846484 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124846484 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124846484 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124846484 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124846484 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124846509 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124846526 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124846526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124846526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:49.433423 run osmo-msc_10.42.42.6(pid=6856): ERR: Terminated: ERROR {rc=2} [trial-2360↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6856)] 12:48:49.481446 run osmo-msc_10.42.42.6(pid=6856): stdout: | (launched: 2022-12-09_12:48:48.354966) 12:48:49.531219 run osmo-msc_10.42.42.6(pid=6856): stderr: | 20221209124848630 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124848630 DLGLOBAL DEBUG validating counter group 0x7f38769a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124848630 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124848630 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124848630 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124848630 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124848632 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124848633 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124848633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124848633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:48:49.581506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6849): Terminating (SIGTERM) 12:48:49.621799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6852): Terminating (SIGTERM) 12:48:49.661960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6855): Terminating (SIGTERM) 12:48:49.702805 --- ParallelTerminationStrategy: PID 6849 died... 12:48:49.721969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6849): Terminated: ok {rc=0} 12:48:49.765949 --- ParallelTerminationStrategy: PID 6852 died... 12:48:49.784594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6852): Terminated: ok {rc=0} 12:48:49.828675 --- ParallelTerminationStrategy: PID 6855 died... 12:48:49.847315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6855): Terminated: ok {rc=0} 12:48:49.933740 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:48:51.134369 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:48:51.141255 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:48:51.162068 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:48:51.189443 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:48:51.243054 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:48:51.264072 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:48:51.291456 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:48:51.840398 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:48:51.892362 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:48:51.903437 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:48:51.959544 tst mo_mt_call.py: using LAC 21568 12:48:52.095605 tst mo_mt_call.py: using RAC 148 12:48:52.222311 tst mo_mt_call.py: using CellId 21568 12:48:52.347817 tst mo_mt_call.py: using BVCI 21569 12:48:52.461316 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:48:52.472440 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:48:52.483418 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:48:52.494449 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:48:52.505458 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:48:52.516466 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:48:52.636180 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:48:52.752352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:48:53.234023 run create_hlr_db(pid=6861): Launched 12:48:53.361892 bus /sierra_2: Setting Powered False 12:48:54.423822 run create_hlr_db(pid=6861): Terminated: ok {rc=0} 12:48:54.875079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6863): Launched 12:48:55.207525 run osmo-hlr_10.42.42.2(pid=6864): Launched 12:48:55.336673 run osmo-stp_10.42.42.5: Starting osmo-stp 12:48:55.908201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6866): Launched 12:48:56.242189 run osmo-stp_10.42.42.5(pid=6867): Launched 12:48:56.369053 run osmo-msc_10.42.42.6: Starting osmo-msc 12:48:56.967625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6869): Launched 12:48:57.300703 run osmo-msc_10.42.42.6(pid=6870): Launched 12:48:57.487522 run osmo-stp_10.42.42.5(pid=6867): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6867)] 12:48:57.627850 run osmo-stp_10.42.42.5(pid=6867): stdout: | (launched: 2022-12-09_12:48:56.180467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:57.768030 run osmo-stp_10.42.42.5(pid=6867): stderr: | 20221209124856375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124856375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124856375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124856376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124856378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124856378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124856378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:57.907066 run osmo-stp_10.42.42.5(pid=6867): stdout: | (launched: 2022-12-09_12:48:56.180467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:48:58.038915 run osmo-stp_10.42.42.5(pid=6867): stderr: | 20221209124856375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124856375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124856375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124856376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124856378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124856378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124856378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:48:58.197917 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6867): Process ended prematurely: osmo-stp_10.42.42.5(pid=6867) [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6867)] [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:48:58.207557 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:48:58.236351 run osmo-hlr_10.42.42.2(pid=6864): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6864)] 12:48:58.286909 run osmo-hlr_10.42.42.2(pid=6864): stdout: | (launched: 2022-12-09_12:48:55.145943) 12:48:58.339171 run osmo-hlr_10.42.42.2(pid=6864): stderr: | 20221209124855348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124855348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124855348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124855348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124855348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124855348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124855390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124855401 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124855401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124855401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:48:58.412089 run osmo-msc_10.42.42.6(pid=6870): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6870)] 12:48:58.462456 run osmo-msc_10.42.42.6(pid=6870): stdout: | (launched: 2022-12-09_12:48:57.238805) 12:48:58.514646 run osmo-msc_10.42.42.6(pid=6870): stderr: | 20221209124857565 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124857565 DLGLOBAL DEBUG validating counter group 0x7f49be074c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124857565 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124857565 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124857565 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124857566 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124857567 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124857568 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124857568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124857568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:48:58.567240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6863): Terminating (SIGTERM) 12:48:58.609776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6866): Terminating (SIGTERM) 12:48:58.652664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6869): Terminating (SIGTERM) 12:48:58.695928 --- ParallelTerminationStrategy: PID 6863 died... 12:48:58.716093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6863): Terminated: ok {rc=0} 12:48:58.763015 --- ParallelTerminationStrategy: PID 6866 died... 12:48:58.782732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6866): Terminated: ok {rc=0} 12:48:58.829253 --- ParallelTerminationStrategy: PID 6869 died... 12:48:58.848769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6869): Terminated: ok {rc=0} 12:48:58.937875 bus /sierra_3: Setting Powered False 12:49:00.037622 bus /sierra_3: Setting Powered False 12:49:01.159775 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:49:02.314727 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:49:02.327152 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:49:02.592488 tst mo_mt_call_osmux.py: using LAC 21569 12:49:02.721741 tst mo_mt_call_osmux.py: using RAC 149 12:49:02.849840 tst mo_mt_call_osmux.py: using CellId 21569 12:49:02.978157 tst mo_mt_call_osmux.py: using BVCI 21570 12:49:03.100198 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:49:03.111950 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:49:03.123341 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:49:03.134869 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:49:03.146619 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:49:03.158427 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:49:03.281263 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:49:03.403314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:49:03.918946 run create_hlr_db(pid=6872): Launched 12:49:04.046652 bus /sierra_2: Setting Powered False 12:49:05.112614 run create_hlr_db(pid=6872): Terminated: ok {rc=0} 12:49:05.573539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6874): Launched 12:49:05.907551 run osmo-hlr_10.42.42.2(pid=6875): Launched 12:49:06.036535 run osmo-stp_10.42.42.5: Starting osmo-stp 12:49:06.606766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6877): Launched 12:49:06.940389 run osmo-stp_10.42.42.5(pid=6878): Launched 12:49:07.069495 run osmo-msc_10.42.42.6: Starting osmo-msc 12:49:07.669855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6880): Launched 12:49:08.003700 run osmo-msc_10.42.42.6(pid=6881): Launched 12:49:08.190992 run osmo-stp_10.42.42.5(pid=6878): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6878)] 12:49:08.331156 run osmo-stp_10.42.42.5(pid=6878): stdout: | (launched: 2022-12-09_12:49:06.878808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:08.471352 run osmo-stp_10.42.42.5(pid=6878): stderr: | 20221209124907073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124907073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124907073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124907074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124907076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124907076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124907076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:08.610052 run osmo-stp_10.42.42.5(pid=6878): stdout: | (launched: 2022-12-09_12:49:06.878808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:08.742380 run osmo-stp_10.42.42.5(pid=6878): stderr: | 20221209124907073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124907073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124907073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124907074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124907076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124907076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124907076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:08.900427 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6878): Process ended prematurely: osmo-stp_10.42.42.5(pid=6878) [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6878)] [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:49:08.910193 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 12:49:08.939621 run osmo-hlr_10.42.42.2(pid=6875): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6875)] 12:49:08.991052 run osmo-hlr_10.42.42.2(pid=6875): stdout: | (launched: 2022-12-09_12:49:05.845818) 12:49:09.044135 run osmo-hlr_10.42.42.2(pid=6875): stderr: | 20221209124906049 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124906049 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124906049 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124906049 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124906049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124906049 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124906077 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124906087 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124906087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124906088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:49:09.118458 run osmo-msc_10.42.42.6(pid=6881): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6881)] 12:49:09.169924 run osmo-msc_10.42.42.6(pid=6881): stdout: | (launched: 2022-12-09_12:49:07.941741) 12:49:09.222952 run osmo-msc_10.42.42.6(pid=6881): stderr: | 20221209124908267 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124908267 DLGLOBAL DEBUG validating counter group 0x7f5b40917c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124908268 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124908268 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124908268 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124908268 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124908271 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124908271 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124908271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124908271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:49:09.276194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6874): Terminating (SIGTERM) 12:49:09.319064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6877): Terminating (SIGTERM) 12:49:09.362062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6880): Terminating (SIGTERM) 12:49:09.405088 --- ParallelTerminationStrategy: PID 6874 died... 12:49:09.425435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6874): Terminated: ok {rc=0} 12:49:09.472773 --- ParallelTerminationStrategy: PID 6877 died... 12:49:09.492803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6877): Terminated: ok {rc=0} 12:49:09.540089 --- ParallelTerminationStrategy: PID 6880 died... 12:49:09.560082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6880): Terminated: ok {rc=0} 12:49:09.649369 bus /sierra_3: Setting Powered False 12:49:10.749173 bus /sierra_3: Setting Powered False 12:49:11.867123 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:49:13.112462 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:49:13.118832 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:49:13.139971 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:49:13.166812 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:49:13.216816 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:49:13.237458 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:49:13.263915 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:49:13.820338 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:49:13.869480 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:49:13.880387 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:49:13.935192 tst mo_mt_call.py: using LAC 21570 12:49:14.056769 tst mo_mt_call.py: using RAC 150 12:49:14.181823 tst mo_mt_call.py: using CellId 21570 12:49:14.312191 tst mo_mt_call.py: using BVCI 21571 12:49:14.433041 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:49:14.444593 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:49:14.456045 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:49:14.467759 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:49:14.479298 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:49:14.490860 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:49:14.610029 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:49:14.725695 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:49:15.208368 run create_hlr_db(pid=6887): Launched 12:49:15.335318 bus /sierra_2: Setting Powered False 12:49:16.395309 run create_hlr_db(pid=6887): Terminated: ok {rc=0} 12:49:16.842786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6889): Launched 12:49:17.171650 run osmo-hlr_10.42.42.2(pid=6890): Launched 12:49:17.299067 run osmo-stp_10.42.42.5: Starting osmo-stp 12:49:17.874370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6892): Launched 12:49:18.207865 run osmo-stp_10.42.42.5(pid=6893): Launched 12:49:18.335872 run osmo-msc_10.42.42.6: Starting osmo-msc 12:49:18.935907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6895): Launched 12:49:19.271636 run osmo-msc_10.42.42.6(pid=6896): Launched 12:49:19.458707 run osmo-stp_10.42.42.5(pid=6893): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6893)] 12:49:19.600160 run osmo-stp_10.42.42.5(pid=6893): stdout: | (launched: 2022-12-09_12:49:18.146363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:19.743221 run osmo-stp_10.42.42.5(pid=6893): stderr: | 20221209124918343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124918343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124918343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124918344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124918344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124918344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124918344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:19.881937 run osmo-stp_10.42.42.5(pid=6893): stdout: | (launched: 2022-12-09_12:49:18.146363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:20.014335 run osmo-stp_10.42.42.5(pid=6893): stderr: | 20221209124918343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124918343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124918343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124918344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124918344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124918344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124918344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:20.173153 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6893): Process ended prematurely: osmo-stp_10.42.42.5(pid=6893) [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6893)] [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:49:20.182916 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:49:20.211678 run osmo-hlr_10.42.42.2(pid=6890): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6890)] 12:49:20.262796 run osmo-hlr_10.42.42.2(pid=6890): stdout: | (launched: 2022-12-09_12:49:17.113114) 12:49:20.315528 run osmo-hlr_10.42.42.2(pid=6890): stderr: | 20221209124917311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124917311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124917311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124917311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124917311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124917311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124917325 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124917333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124917333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124917333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:49:20.388629 run osmo-msc_10.42.42.6(pid=6896): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6896)] 12:49:20.439608 run osmo-msc_10.42.42.6(pid=6896): stdout: | (launched: 2022-12-09_12:49:19.209631) 12:49:20.492353 run osmo-msc_10.42.42.6(pid=6896): stderr: | 20221209124919534 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124919534 DLGLOBAL DEBUG validating counter group 0x7f959e4eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124919535 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124919535 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124919535 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124919535 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124919537 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124919537 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124919537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124919537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:49:20.545516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6889): Terminating (SIGTERM) 12:49:20.587974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6892): Terminating (SIGTERM) 12:49:20.630500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6895): Terminating (SIGTERM) 12:49:20.673332 --- ParallelTerminationStrategy: PID 6889 died... 12:49:20.693502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6889): Terminated: ok {rc=0} 12:49:20.740452 --- ParallelTerminationStrategy: PID 6892 died... 12:49:20.760117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6892): Terminated: ok {rc=0} 12:49:20.806639 --- ParallelTerminationStrategy: PID 6895 died... 12:49:20.826404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6895): Terminated: ok {rc=0} 12:49:20.915155 bus /sierra_3: Setting Powered False 12:49:22.015390 bus /sierra_3: Setting Powered False 12:49:23.135424 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:49:24.283199 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:49:24.295068 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:49:24.351509 tst mo_mt_call_osmux.py: using LAC 21571 12:49:24.474879 tst mo_mt_call_osmux.py: using RAC 151 12:49:24.597746 tst mo_mt_call_osmux.py: using CellId 21571 12:49:24.719774 tst mo_mt_call_osmux.py: using BVCI 21572 12:49:24.833849 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:49:24.845076 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:49:24.855959 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:49:24.866862 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:49:24.877701 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:49:24.888536 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:49:25.004847 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:49:25.125270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:49:25.642196 run create_hlr_db(pid=6898): Launched 12:49:25.770571 bus /sierra_2: Setting Powered False 12:49:26.833689 run create_hlr_db(pid=6898): Terminated: ok {rc=0} 12:49:27.276550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6900): Launched 12:49:27.589405 run osmo-hlr_10.42.42.2(pid=6901): Launched 12:49:27.708080 run osmo-stp_10.42.42.5: Starting osmo-stp 12:49:28.253958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6903): Launched 12:49:28.565568 run osmo-stp_10.42.42.5(pid=6904): Launched 12:49:28.683094 run osmo-msc_10.42.42.6: Starting osmo-msc 12:49:29.242832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6906): Launched 12:49:29.555733 run osmo-msc_10.42.42.6(pid=6907): Launched 12:49:29.729154 run osmo-stp_10.42.42.5(pid=6904): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6904)] 12:49:29.859550 run osmo-stp_10.42.42.5(pid=6904): stdout: | (launched: 2022-12-09_12:49:28.507114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:29.990284 run osmo-stp_10.42.42.5(pid=6904): stderr: | 20221209124928682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124928683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124928683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124928683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124928684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124928684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124928684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:30.118408 run osmo-stp_10.42.42.5(pid=6904): stdout: | (launched: 2022-12-09_12:49:28.507114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:30.240840 run osmo-stp_10.42.42.5(pid=6904): stderr: | 20221209124928682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124928683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124928683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124928683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124928684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124928684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124928684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:30.387695 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6904): Process ended prematurely: osmo-stp_10.42.42.5(pid=6904) [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6904)] [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:49:30.396478 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:49:30.423224 run osmo-hlr_10.42.42.2(pid=6901): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6901)] 12:49:30.470578 run osmo-hlr_10.42.42.2(pid=6901): stdout: | (launched: 2022-12-09_12:49:27.531174) 12:49:30.519769 run osmo-hlr_10.42.42.2(pid=6901): stderr: | 20221209124927709 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124927709 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124927709 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124927709 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124927710 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124927710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124927722 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124927730 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124927730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124927730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:49:30.588288 run osmo-msc_10.42.42.6(pid=6907): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6907)] 12:49:30.635838 run osmo-msc_10.42.42.6(pid=6907): stdout: | (launched: 2022-12-09_12:49:29.497281) 12:49:30.685076 run osmo-msc_10.42.42.6(pid=6907): stderr: | 20221209124929773 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124929773 DLGLOBAL DEBUG validating counter group 0x7fcc5b080c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124929773 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124929773 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124929773 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124929773 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124929777 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124929777 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124929777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124929777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:49:30.734635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6900): Terminating (SIGTERM) 12:49:30.774108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6903): Terminating (SIGTERM) 12:49:30.813605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6906): Terminating (SIGTERM) 12:49:30.860277 --- ParallelTerminationStrategy: PID 6900 died... 12:49:30.888442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6900): Terminated: ok {rc=0} 12:49:30.936166 --- ParallelTerminationStrategy: PID 6903 died... 12:49:30.955048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6903): Terminated: ok {rc=0} 12:49:30.999165 --- ParallelTerminationStrategy: PID 6906 died... 12:49:31.018126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6906): Terminated: ok {rc=0} 12:49:31.102636 bus /sierra_3: Setting Powered False 12:49:32.194854 bus /sierra_3: Setting Powered False 12:49:33.307066 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:49:34.539747 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:49:34.546185 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:49:34.567220 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:49:34.594159 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:49:34.647319 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:49:34.668193 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:49:34.694553 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:49:35.245847 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:49:35.294959 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:49:35.306155 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:49:35.361926 tst mo_mt_call.py: using LAC 21572 12:49:35.483253 tst mo_mt_call.py: using RAC 152 12:49:35.606987 tst mo_mt_call.py: using CellId 21572 12:49:35.737647 tst mo_mt_call.py: using BVCI 21573 12:49:35.858045 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:49:35.869877 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:49:35.881390 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:49:35.893166 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:49:35.904913 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:49:35.917195 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:49:36.038257 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:49:36.160164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:49:36.643287 run create_hlr_db(pid=6912): Launched 12:49:36.772292 bus /sierra_2: Setting Powered False 12:49:37.833600 run create_hlr_db(pid=6912): Terminated: ok {rc=0} 12:49:38.265176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6914): Launched 12:49:38.575350 run osmo-hlr_10.42.42.2(pid=6915): Launched 12:49:38.694804 run osmo-stp_10.42.42.5: Starting osmo-stp 12:49:39.227382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6917): Launched 12:49:39.539154 run osmo-stp_10.42.42.5(pid=6918): Launched 12:49:39.659558 run osmo-msc_10.42.42.6: Starting osmo-msc 12:49:40.220880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6920): Launched 12:49:40.533131 run osmo-msc_10.42.42.6(pid=6921): Launched 12:49:40.707312 run osmo-stp_10.42.42.5(pid=6918): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6918)] 12:49:40.837536 run osmo-stp_10.42.42.5(pid=6918): stdout: | (launched: 2022-12-09_12:49:39.480828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:40.967565 run osmo-stp_10.42.42.5(pid=6918): stderr: | 20221209124939653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124939653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124939654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124939654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124939656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124939657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124939657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:41.095945 run osmo-stp_10.42.42.5(pid=6918): stdout: | (launched: 2022-12-09_12:49:39.480828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:41.218433 run osmo-stp_10.42.42.5(pid=6918): stderr: | 20221209124939653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124939653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124939654 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124939654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124939656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124939657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124939657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:41.364779 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6918): Process ended prematurely: osmo-stp_10.42.42.5(pid=6918) [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6918)] [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:49:41.373704 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:49:41.399915 run osmo-hlr_10.42.42.2(pid=6915): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6915)] 12:49:41.447315 run osmo-hlr_10.42.42.2(pid=6915): stdout: | (launched: 2022-12-09_12:49:38.517256) 12:49:41.496588 run osmo-hlr_10.42.42.2(pid=6915): stderr: | 20221209124938697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124938697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124938697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124938697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124938697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124938697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124938709 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124938717 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124938717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124938718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:49:41.565380 run osmo-msc_10.42.42.6(pid=6921): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6921)] 12:49:41.613876 run osmo-msc_10.42.42.6(pid=6921): stdout: | (launched: 2022-12-09_12:49:40.474545) 12:49:41.663031 run osmo-msc_10.42.42.6(pid=6921): stderr: | 20221209124940750 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124940751 DLGLOBAL DEBUG validating counter group 0x7f9a19cfcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124940751 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124940751 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124940751 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124940751 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124940753 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124940753 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124940753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124940754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:49:41.712639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6914): Terminating (SIGTERM) 12:49:41.752237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6917): Terminating (SIGTERM) 12:49:41.791629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6920): Terminating (SIGTERM) 12:49:41.831344 --- ParallelTerminationStrategy: PID 6914 died... 12:49:41.850332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6914): Terminated: ok {rc=0} 12:49:41.894219 --- ParallelTerminationStrategy: PID 6917 died... 12:49:41.912688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6917): Terminated: ok {rc=0} 12:49:41.956171 --- ParallelTerminationStrategy: PID 6920 died... 12:49:41.974679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6920): Terminated: ok {rc=0} 12:49:42.059983 bus /sierra_3: Setting Powered False 12:49:43.160421 bus /sierra_3: Setting Powered False 12:49:44.273961 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:49:45.416575 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:49:45.428469 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:49:45.485351 tst mo_mt_call_osmux.py: using LAC 21573 12:49:45.607735 tst mo_mt_call_osmux.py: using RAC 153 12:49:45.730655 tst mo_mt_call_osmux.py: using CellId 21573 12:49:45.865657 tst mo_mt_call_osmux.py: using BVCI 21574 12:49:46.025504 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:49:46.037314 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:49:46.048872 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:49:46.060581 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:49:46.072260 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:49:46.083848 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:49:46.203114 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:49:46.350884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:49:46.868910 run create_hlr_db(pid=6923): Launched 12:49:47.028283 bus /sierra_2: Setting Powered False 12:49:48.090095 run create_hlr_db(pid=6923): Terminated: ok {rc=0} 12:49:48.541853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6925): Launched 12:49:48.875930 run osmo-hlr_10.42.42.2(pid=6926): Launched 12:49:49.003729 run osmo-stp_10.42.42.5: Starting osmo-stp 12:49:49.575029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6928): Launched 12:49:49.907837 run osmo-stp_10.42.42.5(pid=6929): Launched 12:49:50.034980 run osmo-msc_10.42.42.6: Starting osmo-msc 12:49:50.635415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6931): Launched 12:49:50.970006 run osmo-msc_10.42.42.6(pid=6932): Launched 12:49:51.154812 run osmo-stp_10.42.42.5(pid=6929): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6929)] 12:49:51.294389 run osmo-stp_10.42.42.5(pid=6929): stdout: | (launched: 2022-12-09_12:49:49.845996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:51.434919 run osmo-stp_10.42.42.5(pid=6929): stderr: | 20221209124950042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124950042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124950043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124950043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124950043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124950043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124950044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:51.574055 run osmo-stp_10.42.42.5(pid=6929): stdout: | (launched: 2022-12-09_12:49:49.845996) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:49:51.706091 run osmo-stp_10.42.42.5(pid=6929): stderr: | 20221209124950042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124950042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124950043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124950043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124950043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124950043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124950044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:49:51.863578 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6929): Process ended prematurely: osmo-stp_10.42.42.5(pid=6929) [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6929)] [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:49:51.873255 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:49:51.901883 run osmo-hlr_10.42.42.2(pid=6926): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6926)] 12:49:51.953137 run osmo-hlr_10.42.42.2(pid=6926): stdout: | (launched: 2022-12-09_12:49:48.814124) 12:49:52.005784 run osmo-hlr_10.42.42.2(pid=6926): stderr: | 20221209124949015 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124949015 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124949015 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124949015 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124949015 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124949015 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124949027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124949036 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124949037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124949037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:49:52.079337 run osmo-msc_10.42.42.6(pid=6932): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6932)] 12:49:52.130298 run osmo-msc_10.42.42.6(pid=6932): stdout: | (launched: 2022-12-09_12:49:50.907927) 12:49:52.182832 run osmo-msc_10.42.42.6(pid=6932): stderr: | 20221209124951234 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124951235 DLGLOBAL DEBUG validating counter group 0x7ffb4c030c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124951235 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124951235 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124951235 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124951235 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124951237 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124951237 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124951237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124951237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:49:52.235689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6925): Terminating (SIGTERM) 12:49:52.277896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6928): Terminating (SIGTERM) 12:49:52.320411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6931): Terminating (SIGTERM) 12:49:52.363229 --- ParallelTerminationStrategy: PID 6925 died... 12:49:52.383404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6925): Terminated: ok {rc=0} 12:49:52.430289 --- ParallelTerminationStrategy: PID 6928 died... 12:49:52.449995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6928): Terminated: ok {rc=0} 12:49:52.496728 --- ParallelTerminationStrategy: PID 6931 died... 12:49:52.516332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6931): Terminated: ok {rc=0} 12:49:52.604808 bus /sierra_3: Setting Powered False 12:49:53.704836 bus /sierra_3: Setting Powered False 12:49:54.821954 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 12:49:56.067477 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:49:56.074630 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 12:49:56.096645 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 12:49:56.125420 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 12:49:56.177328 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 12:49:56.198587 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 12:49:56.225897 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 12:49:56.778753 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 12:49:56.831652 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:49:56.843151 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:49:56.899919 tst mo_mt_call.py: using LAC 21574 12:49:57.027212 tst mo_mt_call.py: using RAC 154 12:49:57.155598 tst mo_mt_call.py: using CellId 21574 12:49:57.282568 tst mo_mt_call.py: using BVCI 21575 12:49:57.403535 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:49:57.415159 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:49:57.426534 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:49:57.438199 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:49:57.449737 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:49:57.461352 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:49:57.580617 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:49:57.700594 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:49:58.215358 run create_hlr_db(pid=6937): Launched 12:49:58.342913 bus /sierra_2: Setting Powered False 12:49:59.407217 run create_hlr_db(pid=6937): Terminated: ok {rc=0} 12:49:59.847903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6939): Launched 12:50:00.158281 run osmo-hlr_10.42.42.2(pid=6940): Launched 12:50:00.275894 run osmo-stp_10.42.42.5: Starting osmo-stp 12:50:00.809121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6942): Launched 12:50:01.142218 run osmo-stp_10.42.42.5(pid=6943): Launched 12:50:01.380554 run osmo-msc_10.42.42.6: Starting osmo-msc 12:50:02.101650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6948): Launched 12:50:02.446133 run osmo-msc_10.42.42.6(pid=6949): Launched 12:50:02.631347 run osmo-stp_10.42.42.5(pid=6943): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6943)] 12:50:02.772173 run osmo-stp_10.42.42.5(pid=6943): stdout: | (launched: 2022-12-09_12:50:01.083129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:02.912621 run osmo-stp_10.42.42.5(pid=6943): stderr: | 20221209125001411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125001411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125001412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125001412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125001417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125001417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125001417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:03.051277 run osmo-stp_10.42.42.5(pid=6943): stdout: | (launched: 2022-12-09_12:50:01.083129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:03.184071 run osmo-stp_10.42.42.5(pid=6943): stderr: | 20221209125001411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125001411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125001412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125001412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125001417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125001417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125001417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:03.342655 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6943): Process ended prematurely: osmo-stp_10.42.42.5(pid=6943) [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6943)] [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 12:50:03.352424 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 12:50:03.381018 run osmo-hlr_10.42.42.2(pid=6940): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6940)] 12:50:03.431468 run osmo-hlr_10.42.42.2(pid=6940): stdout: | (launched: 2022-12-09_12:50:00.100085) 12:50:03.483637 run osmo-hlr_10.42.42.2(pid=6940): stderr: | 20221209125000279 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125000279 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125000280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125000280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125000280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125000280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125000323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125000333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125000333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125000333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:50:03.555753 run osmo-msc_10.42.42.6(pid=6949): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6949)] 12:50:03.605882 run osmo-msc_10.42.42.6(pid=6949): stdout: | (launched: 2022-12-09_12:50:02.384279) 12:50:03.657779 run osmo-msc_10.42.42.6(pid=6949): stderr: | 20221209125002708 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125002708 DLGLOBAL DEBUG validating counter group 0x7fe7ee255c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125002708 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125002708 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125002708 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125002708 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125002710 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125002710 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125002711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125002711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:50:03.710365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6939): Terminating (SIGTERM) 12:50:03.752365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6942): Terminating (SIGTERM) 12:50:03.794416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6948): Terminating (SIGTERM) 12:50:03.836597 --- ParallelTerminationStrategy: PID 6939 died... 12:50:03.856593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6939): Terminated: ok {rc=0} 12:50:03.903202 --- ParallelTerminationStrategy: PID 6942 died... 12:50:03.922555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6942): Terminated: ok {rc=0} 12:50:03.969148 --- ParallelTerminationStrategy: PID 6948 died... 12:50:03.988632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6948): Terminated: ok {rc=0} 12:50:04.076648 bus /sierra_3: Setting Powered False 12:50:05.175451 bus /sierra_3: Setting Powered False 12:50:06.292936 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 12:50:07.439773 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:50:07.451669 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:50:07.508919 tst mo_mt_call_osmux.py: using LAC 21575 12:50:07.632930 tst mo_mt_call_osmux.py: using RAC 155 12:50:07.756886 tst mo_mt_call_osmux.py: using CellId 21575 12:50:07.887791 tst mo_mt_call_osmux.py: using BVCI 21576 12:50:08.008151 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:50:08.019900 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:50:08.031440 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:50:08.043207 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:50:08.055031 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:50:08.066682 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:50:08.184394 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:50:08.304825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:50:08.821065 run create_hlr_db(pid=6951): Launched 12:50:08.948220 bus /sierra_2: Setting Powered False 12:50:10.012592 run create_hlr_db(pid=6951): Terminated: ok {rc=0} 12:50:10.455624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6953): Launched 12:50:10.767853 run osmo-hlr_10.42.42.2(pid=6954): Launched 12:50:10.888576 run osmo-stp_10.42.42.5: Starting osmo-stp 12:50:11.442868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6956): Launched 12:50:11.754725 run osmo-stp_10.42.42.5(pid=6957): Launched 12:50:11.875182 run osmo-msc_10.42.42.6: Starting osmo-msc 12:50:12.434863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6959): Launched 12:50:12.747504 run osmo-msc_10.42.42.6(pid=6960): Launched 12:50:12.921119 run osmo-stp_10.42.42.5(pid=6957): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6957)] 12:50:13.051135 run osmo-stp_10.42.42.5(pid=6957): stdout: | (launched: 2022-12-09_12:50:11.696595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:13.181426 run osmo-stp_10.42.42.5(pid=6957): stderr: | 20221209125011872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125011872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125011872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125011873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125011873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125011873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125011873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:13.309274 run osmo-stp_10.42.42.5(pid=6957): stdout: | (launched: 2022-12-09_12:50:11.696595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:13.431995 run osmo-stp_10.42.42.5(pid=6957): stderr: | 20221209125011872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125011872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125011872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125011873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125011873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125011873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125011873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:13.578610 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6957): Process ended prematurely: osmo-stp_10.42.42.5(pid=6957) [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6957)] [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 12:50:13.587726 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:50:13.613963 run osmo-hlr_10.42.42.2(pid=6954): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6954)] 12:50:13.661417 run osmo-hlr_10.42.42.2(pid=6954): stdout: | (launched: 2022-12-09_12:50:10.709785) 12:50:13.711106 run osmo-hlr_10.42.42.2(pid=6954): stderr: | 20221209125010893 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125010893 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125010893 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125010893 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125010894 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125010894 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125010904 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125010913 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125010913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125010913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:50:13.779791 run osmo-msc_10.42.42.6(pid=6960): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6960)] 12:50:13.827474 run osmo-msc_10.42.42.6(pid=6960): stdout: | (launched: 2022-12-09_12:50:12.689439) 12:50:13.877780 run osmo-msc_10.42.42.6(pid=6960): stderr: | 20221209125012967 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125012967 DLGLOBAL DEBUG validating counter group 0x7fd821017c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125012967 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125012967 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125012968 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125012968 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125012969 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125012970 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125012970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125012970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:50:13.927292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6953): Terminating (SIGTERM) 12:50:13.966691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6956): Terminating (SIGTERM) 12:50:14.006242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6959): Terminating (SIGTERM) 12:50:14.045952 --- ParallelTerminationStrategy: PID 6953 died... 12:50:14.064828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6953): Terminated: ok {rc=0} 12:50:14.108722 --- ParallelTerminationStrategy: PID 6956 died... 12:50:14.127436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6956): Terminated: ok {rc=0} 12:50:14.170949 --- ParallelTerminationStrategy: PID 6959 died... 12:50:14.189434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6959): Terminated: ok {rc=0} 12:50:14.274835 bus /sierra_3: Setting Powered False 12:50:15.373799 bus /sierra_3: Setting Powered False 12:50:16.488858 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:50:17.729194 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:50:17.736173 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:50:17.758510 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:50:17.787089 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:50:17.840044 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:50:17.861636 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:50:17.889698 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:50:18.440867 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:50:18.494499 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:50:18.506194 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:50:18.564610 tst mo_mt_call.py: using LAC 21576 12:50:18.695847 tst mo_mt_call.py: using RAC 156 12:50:18.826684 tst mo_mt_call.py: using CellId 21576 12:50:18.957817 tst mo_mt_call.py: using BVCI 21577 12:50:19.078221 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:50:19.089927 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:50:19.101659 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:50:19.113270 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:50:19.124914 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:50:19.136748 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:50:19.252440 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:50:19.373997 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:50:19.891437 run create_hlr_db(pid=6965): Launched 12:50:20.019132 bus /sierra_2: Setting Powered False 12:50:21.084052 run create_hlr_db(pid=6965): Terminated: ok {rc=0} 12:50:21.526829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6967): Launched 12:50:21.839046 run osmo-hlr_10.42.42.2(pid=6968): Launched 12:50:21.959836 run osmo-stp_10.42.42.5: Starting osmo-stp 12:50:22.509362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6970): Launched 12:50:22.822475 run osmo-stp_10.42.42.5(pid=6971): Launched 12:50:22.942737 run osmo-msc_10.42.42.6: Starting osmo-msc 12:50:23.503172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6973): Launched 12:50:23.816195 run osmo-msc_10.42.42.6(pid=6974): Launched 12:50:23.991535 run osmo-stp_10.42.42.5(pid=6971): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6971)] 12:50:24.122143 run osmo-stp_10.42.42.5(pid=6971): stdout: | (launched: 2022-12-09_12:50:22.764332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:24.252468 run osmo-stp_10.42.42.5(pid=6971): stderr: | 20221209125022940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125022940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125022940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125022940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125022941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125022941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125022941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:24.381578 run osmo-stp_10.42.42.5(pid=6971): stdout: | (launched: 2022-12-09_12:50:22.764332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:24.505078 run osmo-stp_10.42.42.5(pid=6971): stderr: | 20221209125022940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125022940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125022940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125022940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125022941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125022941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125022941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:24.652758 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6971): Process ended prematurely: osmo-stp_10.42.42.5(pid=6971) [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6971)] [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:50:24.661975 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:50:24.688705 run osmo-hlr_10.42.42.2(pid=6968): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6968)] 12:50:24.736716 run osmo-hlr_10.42.42.2(pid=6968): stdout: | (launched: 2022-12-09_12:50:21.780921) 12:50:24.786316 run osmo-hlr_10.42.42.2(pid=6968): stderr: | 20221209125021961 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125021961 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125021961 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125021961 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125021961 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125021961 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125021974 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125021982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125021982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125021982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:50:24.855197 run osmo-msc_10.42.42.6(pid=6974): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6974)] 12:50:24.902923 run osmo-msc_10.42.42.6(pid=6974): stdout: | (launched: 2022-12-09_12:50:23.758009) 12:50:24.952235 run osmo-msc_10.42.42.6(pid=6974): stderr: | 20221209125024035 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125024035 DLGLOBAL DEBUG validating counter group 0x7fd63df7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125024036 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125024036 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125024036 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125024036 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125024038 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125024038 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125024038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125024038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:50:25.001956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6967): Terminating (SIGTERM) 12:50:25.041901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6970): Terminating (SIGTERM) 12:50:25.081997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6973): Terminating (SIGTERM) 12:50:25.122312 --- ParallelTerminationStrategy: PID 6967 died... 12:50:25.141523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6967): Terminated: ok {rc=0} 12:50:25.185903 --- ParallelTerminationStrategy: PID 6970 died... 12:50:25.204628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6970): Terminated: ok {rc=0} 12:50:25.248574 --- ParallelTerminationStrategy: PID 6973 died... 12:50:25.267426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6973): Terminated: ok {rc=0} 12:50:25.354054 bus /sierra_3: Setting Powered False 12:50:26.453875 bus /sierra_3: Setting Powered False 12:50:27.567514 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:50:28.717767 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:50:28.730144 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:50:28.788513 tst mo_mt_call_osmux.py: using LAC 21577 12:50:28.919155 tst mo_mt_call_osmux.py: using RAC 157 12:50:29.050231 tst mo_mt_call_osmux.py: using CellId 21577 12:50:29.181870 tst mo_mt_call_osmux.py: using BVCI 21578 12:50:29.302245 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:50:29.313890 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:50:29.325462 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:50:29.337047 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:50:29.348542 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:50:29.360218 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:50:29.479922 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:50:29.603641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:50:30.118770 run create_hlr_db(pid=6976): Launched 12:50:30.246608 bus /sierra_2: Setting Powered False 12:50:31.318520 run create_hlr_db(pid=6976): Terminated: ok {rc=0} 12:50:31.787522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6978): Launched 12:50:32.134375 run osmo-hlr_10.42.42.2(pid=6979): Launched 12:50:32.271739 run osmo-stp_10.42.42.5: Starting osmo-stp 12:50:32.846751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6981): Launched 12:50:33.179725 run osmo-stp_10.42.42.5(pid=6982): Launched 12:50:33.305789 run osmo-msc_10.42.42.6: Starting osmo-msc 12:50:33.904816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6984): Launched 12:50:34.239064 run osmo-msc_10.42.42.6(pid=6985): Launched 12:50:34.424798 run osmo-stp_10.42.42.5(pid=6982): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6982)] 12:50:34.563980 run osmo-stp_10.42.42.5(pid=6982): stdout: | (launched: 2022-12-09_12:50:33.117992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:34.703746 run osmo-stp_10.42.42.5(pid=6982): stderr: | 20221209125033312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125033312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125033312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125033313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125033313 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125033313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125033313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:34.842633 run osmo-stp_10.42.42.5(pid=6982): stdout: | (launched: 2022-12-09_12:50:33.117992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:34.974951 run osmo-stp_10.42.42.5(pid=6982): stderr: | 20221209125033312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125033312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125033312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125033313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125033313 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125033313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125033313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:35.133458 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6982): Process ended prematurely: osmo-stp_10.42.42.5(pid=6982) [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6982)] [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:50:35.142911 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:50:35.171092 run osmo-hlr_10.42.42.2(pid=6979): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6979)] 12:50:35.222065 run osmo-hlr_10.42.42.2(pid=6979): stdout: | (launched: 2022-12-09_12:50:32.072352) 12:50:35.273903 run osmo-hlr_10.42.42.2(pid=6979): stderr: | 20221209125032346 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125032346 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125032346 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125032346 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125032346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125032346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125032358 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125032367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125032367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125032367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:50:35.346154 run osmo-msc_10.42.42.6(pid=6985): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6985)] 12:50:35.396337 run osmo-msc_10.42.42.6(pid=6985): stdout: | (launched: 2022-12-09_12:50:34.177570) 12:50:35.448172 run osmo-msc_10.42.42.6(pid=6985): stderr: | 20221209125034502 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125034502 DLGLOBAL DEBUG validating counter group 0x7f5bad428c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125034502 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125034502 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125034502 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125034502 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125034504 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125034505 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125034505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125034505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:50:35.500295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6978): Terminating (SIGTERM) 12:50:35.542458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6981): Terminating (SIGTERM) 12:50:35.584327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6984): Terminating (SIGTERM) 12:50:35.626604 --- ParallelTerminationStrategy: PID 6978 died... 12:50:35.646492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6978): Terminated: ok {rc=0} 12:50:35.692865 --- ParallelTerminationStrategy: PID 6981 died... 12:50:35.712389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6981): Terminated: ok {rc=0} 12:50:35.758564 --- ParallelTerminationStrategy: PID 6984 died... 12:50:35.778045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6984): Terminated: ok {rc=0} 12:50:35.866459 bus /sierra_3: Setting Powered False 12:50:36.965637 bus /sierra_3: Setting Powered False 12:50:38.081703 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:50:39.324540 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:50:39.332218 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:50:39.354892 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:50:39.382778 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:50:39.435233 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:50:39.456164 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:50:39.482892 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:50:40.035063 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:50:40.086175 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:50:40.097669 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:50:40.153425 tst mo_mt_call.py: using LAC 21578 12:50:40.276663 tst mo_mt_call.py: using RAC 158 12:50:40.397128 tst mo_mt_call.py: using CellId 21578 12:50:40.517529 tst mo_mt_call.py: using BVCI 21579 12:50:40.629664 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:50:40.641097 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:50:40.652250 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:50:40.663670 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:50:40.675107 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:50:40.686540 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:50:40.801326 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:50:40.922453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:50:41.404519 run create_hlr_db(pid=6990): Launched 12:50:41.530366 bus /sierra_2: Setting Powered False 12:50:42.591971 run create_hlr_db(pid=6990): Terminated: ok {rc=0} 12:50:43.024605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6992): Launched 12:50:43.336942 run osmo-hlr_10.42.42.2(pid=6993): Launched 12:50:43.457349 run osmo-stp_10.42.42.5: Starting osmo-stp 12:50:43.990280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6995): Launched 12:50:44.302921 run osmo-stp_10.42.42.5(pid=6996): Launched 12:50:44.422943 run osmo-msc_10.42.42.6: Starting osmo-msc 12:50:44.982789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6998): Launched 12:50:45.295283 run osmo-msc_10.42.42.6(pid=6999): Launched 12:50:45.470298 run osmo-stp_10.42.42.5(pid=6996): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6996)] 12:50:45.600696 run osmo-stp_10.42.42.5(pid=6996): stdout: | (launched: 2022-12-09_12:50:44.244566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:45.731518 run osmo-stp_10.42.42.5(pid=6996): stderr: | 20221209125044417 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125044417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125044417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125044417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125044419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125044420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125044420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:45.879771 run osmo-stp_10.42.42.5(pid=6996): stdout: | (launched: 2022-12-09_12:50:44.244566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:46.005638 run osmo-stp_10.42.42.5(pid=6996): stderr: | 20221209125044417 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125044417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125044417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125044417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125044419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125044420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125044420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:46.156703 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=6996): Process ended prematurely: osmo-stp_10.42.42.5(pid=6996) [trial-2360↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6996)] [trial-2360↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:50:46.166317 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:50:46.193565 run osmo-hlr_10.42.42.2(pid=6993): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6993)] 12:50:46.242915 run osmo-hlr_10.42.42.2(pid=6993): stdout: | (launched: 2022-12-09_12:50:43.278527) 12:50:46.293983 run osmo-hlr_10.42.42.2(pid=6993): stderr: | 20221209125043459 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125043459 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125043459 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125043459 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125043459 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125043459 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125043476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125043484 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125043485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125043485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:50:46.365044 run osmo-msc_10.42.42.6(pid=6999): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6999)] 12:50:46.413663 run osmo-msc_10.42.42.6(pid=6999): stdout: | (launched: 2022-12-09_12:50:45.236928) 12:50:46.464600 run osmo-msc_10.42.42.6(pid=6999): stderr: | 20221209125045512 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125045512 DLGLOBAL DEBUG validating counter group 0x7f1722022c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125045512 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125045512 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125045513 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125045513 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125045514 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125045515 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125045515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125045515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:50:46.516124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6992): Terminating (SIGTERM) 12:50:46.557253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6995): Terminating (SIGTERM) 12:50:46.599591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6998): Terminating (SIGTERM) 12:50:46.640621 --- ParallelTerminationStrategy: PID 6992 died... 12:50:46.659800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6992): Terminated: ok {rc=0} 12:50:46.708017 --- ParallelTerminationStrategy: PID 6995 died... 12:50:46.727659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6995): Terminated: ok {rc=0} 12:50:46.773201 --- ParallelTerminationStrategy: PID 6998 died... 12:50:46.792427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6998): Terminated: ok {rc=0} 12:50:46.890753 bus /sierra_3: Setting Powered False 12:50:48.004101 bus /sierra_3: Setting Powered False 12:50:49.121801 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:50:50.273591 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:50:50.286301 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:50:50.345780 tst mo_mt_call_osmux.py: using LAC 21579 12:50:50.476422 tst mo_mt_call_osmux.py: using RAC 159 12:50:50.606934 tst mo_mt_call_osmux.py: using CellId 21579 12:50:50.738446 tst mo_mt_call_osmux.py: using BVCI 21580 12:50:50.860932 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:50:50.872657 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:50:50.884304 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:50:50.896471 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:50:50.909013 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:50:50.921478 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:50:51.041274 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:50:51.163470 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:50:51.680141 run create_hlr_db(pid=7001): Launched 12:50:51.807481 bus /sierra_2: Setting Powered False 12:50:52.873119 run create_hlr_db(pid=7001): Terminated: ok {rc=0} 12:50:53.315465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7003): Launched 12:50:53.628933 run osmo-hlr_10.42.42.2(pid=7004): Launched 12:50:53.748700 run osmo-stp_10.42.42.5: Starting osmo-stp 12:50:54.287703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7006): Launched 12:50:54.599367 run osmo-stp_10.42.42.5(pid=7007): Launched 12:50:54.718665 run osmo-msc_10.42.42.6: Starting osmo-msc 12:50:55.279429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7009): Launched 12:50:55.591072 run osmo-msc_10.42.42.6(pid=7010): Launched 12:50:55.764745 run osmo-stp_10.42.42.5(pid=7007): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7007)] 12:50:55.894141 run osmo-stp_10.42.42.5(pid=7007): stdout: | (launched: 2022-12-09_12:50:54.541329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:56.024005 run osmo-stp_10.42.42.5(pid=7007): stderr: | 20221209125054716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125054717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125054717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125054717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125054718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125054718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125054718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:56.152695 run osmo-stp_10.42.42.5(pid=7007): stdout: | (launched: 2022-12-09_12:50:54.541329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:50:56.276314 run osmo-stp_10.42.42.5(pid=7007): stderr: | 20221209125054716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125054717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125054717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125054717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125054718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125054718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125054718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:50:56.423126 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7007): Process ended prematurely: osmo-stp_10.42.42.5(pid=7007) [trial-2360↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7007)] [trial-2360↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:50:56.432526 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:50:56.459121 run osmo-hlr_10.42.42.2(pid=7004): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7004)] 12:50:56.506836 run osmo-hlr_10.42.42.2(pid=7004): stdout: | (launched: 2022-12-09_12:50:53.570652) 12:50:56.556319 run osmo-hlr_10.42.42.2(pid=7004): stderr: | 20221209125053752 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125053752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125053752 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125053752 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125053752 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125053752 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125053764 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125053773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125053773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125053773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:50:56.625313 run osmo-msc_10.42.42.6(pid=7010): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7010)] 12:50:56.672844 run osmo-msc_10.42.42.6(pid=7010): stdout: | (launched: 2022-12-09_12:50:55.532772) 12:50:56.721863 run osmo-msc_10.42.42.6(pid=7010): stderr: | 20221209125055806 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125055806 DLGLOBAL DEBUG validating counter group 0x7fe38f36cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125055806 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125055806 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125055806 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125055807 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125055808 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125055809 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125055809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125055809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:50:56.771122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7003): Terminating (SIGTERM) 12:50:56.810539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7006): Terminating (SIGTERM) 12:50:56.850087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7009): Terminating (SIGTERM) 12:50:56.889833 --- ParallelTerminationStrategy: PID 7003 died... 12:50:56.908700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7003): Terminated: ok {rc=0} 12:50:56.952657 --- ParallelTerminationStrategy: PID 7006 died... 12:50:56.971228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7006): Terminated: ok {rc=0} 12:50:57.014914 --- ParallelTerminationStrategy: PID 7009 died... 12:50:57.033507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7009): Terminated: ok {rc=0} 12:50:57.119379 bus /sierra_3: Setting Powered False 12:50:58.219588 bus /sierra_3: Setting Powered False 12:50:59.335198 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:51:00.568807 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:51:00.574571 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:51:00.595499 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 12:51:00.623361 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 12:51:00.675722 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:51:00.696419 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 12:51:00.723034 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 12:51:01.280704 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 12:51:01.356636 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:51:01.372902 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:51:01.432513 tst mo_mt_call.py: using LAC 21580 12:51:01.560779 tst mo_mt_call.py: using RAC 160 12:51:01.694536 tst mo_mt_call.py: using CellId 21580 12:51:01.828872 tst mo_mt_call.py: using BVCI 21581 12:51:01.954440 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:51:01.967032 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:51:01.980625 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:51:01.995091 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:51:02.008533 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:51:02.020892 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:51:02.164061 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:51:02.299380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:51:02.816751 run create_hlr_db(pid=7015): Launched 12:51:02.945196 bus /sierra_2: Setting Powered False 12:51:04.011022 run create_hlr_db(pid=7015): Terminated: ok {rc=0} 12:51:04.473312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7017): Launched 12:51:04.806366 run osmo-hlr_10.42.42.2(pid=7018): Launched 12:51:04.934101 run osmo-stp_10.42.42.5: Starting osmo-stp 12:51:05.511670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7020): Launched 12:51:05.845712 run osmo-stp_10.42.42.5(pid=7021): Launched 12:51:05.972457 run osmo-msc_10.42.42.6: Starting osmo-msc 12:51:06.575377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7023): Launched 12:51:06.909893 run osmo-msc_10.42.42.6(pid=7024): Launched 12:51:07.094310 run osmo-stp_10.42.42.5(pid=7021): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7021)] 12:51:07.236914 run osmo-stp_10.42.42.5(pid=7021): stdout: | (launched: 2022-12-09_12:51:05.783671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:07.377857 run osmo-stp_10.42.42.5(pid=7021): stderr: | 20221209125105981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125105981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125105981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125105981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125105982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125105982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125105982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:07.518063 run osmo-stp_10.42.42.5(pid=7021): stdout: | (launched: 2022-12-09_12:51:05.783671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:07.651039 run osmo-stp_10.42.42.5(pid=7021): stderr: | 20221209125105981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125105981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125105981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125105981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125105982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125105982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125105982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:07.809821 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7021): Process ended prematurely: osmo-stp_10.42.42.5(pid=7021) [trial-2360↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7021)] [trial-2360↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 12:51:07.819588 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 12:51:07.848136 run osmo-hlr_10.42.42.2(pid=7018): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7018)] 12:51:07.899009 run osmo-hlr_10.42.42.2(pid=7018): stdout: | (launched: 2022-12-09_12:51:04.744468) 12:51:07.951554 run osmo-hlr_10.42.42.2(pid=7018): stderr: | 20221209125104949 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125104949 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125104949 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125104949 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125104949 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125104949 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125104961 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125104970 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125104970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125104970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:51:08.024427 run osmo-msc_10.42.42.6(pid=7024): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7024)] 12:51:08.075137 run osmo-msc_10.42.42.6(pid=7024): stdout: | (launched: 2022-12-09_12:51:06.847720) 12:51:08.127805 run osmo-msc_10.42.42.6(pid=7024): stderr: | 20221209125107177 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125107177 DLGLOBAL DEBUG validating counter group 0x7f7c3e693c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125107177 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125107177 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125107178 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125107178 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125107179 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125107180 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125107180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125107180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:51:08.180312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7017): Terminating (SIGTERM) 12:51:08.222915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7020): Terminating (SIGTERM) 12:51:08.265596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7023): Terminating (SIGTERM) 12:51:08.308421 --- ParallelTerminationStrategy: PID 7017 died... 12:51:08.328761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7017): Terminated: ok {rc=0} 12:51:08.375888 --- ParallelTerminationStrategy: PID 7020 died... 12:51:08.395670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7020): Terminated: ok {rc=0} 12:51:08.442775 --- ParallelTerminationStrategy: PID 7023 died... 12:51:08.462665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7023): Terminated: ok {rc=0} 12:51:08.553102 bus /sierra_3: Setting Powered False 12:51:09.652990 bus /sierra_3: Setting Powered False 12:51:10.770780 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 12:51:11.923140 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:51:11.935362 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:51:11.994125 tst mo_mt_call_osmux.py: using LAC 21581 12:51:12.126092 tst mo_mt_call_osmux.py: using RAC 161 12:51:12.256721 tst mo_mt_call_osmux.py: using CellId 21581 12:51:12.386835 tst mo_mt_call_osmux.py: using BVCI 21582 12:51:12.509224 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:51:12.520800 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:51:12.532125 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:51:12.543563 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:51:12.555110 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:51:12.566926 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:51:12.687005 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:51:12.805168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:51:13.290392 run create_hlr_db(pid=7026): Launched 12:51:13.420910 bus /sierra_2: Setting Powered False 12:51:14.482804 run create_hlr_db(pid=7026): Terminated: ok {rc=0} 12:51:14.916235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7028): Launched 12:51:15.227259 run osmo-hlr_10.42.42.2(pid=7029): Launched 12:51:15.347455 run osmo-stp_10.42.42.5: Starting osmo-stp 12:51:15.902699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7031): Launched 12:51:16.245644 run osmo-stp_10.42.42.5(pid=7032): Launched 12:51:16.476436 run osmo-msc_10.42.42.6: Starting osmo-msc 12:51:17.154807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7034): Launched 12:51:17.502603 run osmo-msc_10.42.42.6(pid=7035): Launched 12:51:17.690170 run osmo-stp_10.42.42.5(pid=7032): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7032)] 12:51:17.830931 run osmo-stp_10.42.42.5(pid=7032): stdout: | (launched: 2022-12-09_12:51:16.183481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:17.972141 run osmo-stp_10.42.42.5(pid=7032): stderr: | 20221209125116413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125116413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125116413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125116414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125116414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125116414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125116414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:18.111152 run osmo-stp_10.42.42.5(pid=7032): stdout: | (launched: 2022-12-09_12:51:16.183481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:18.244003 run osmo-stp_10.42.42.5(pid=7032): stderr: | 20221209125116413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125116413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125116413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125116414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125116414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125116414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125116414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:18.402633 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7032): Process ended prematurely: osmo-stp_10.42.42.5(pid=7032) [trial-2360↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7032)] [trial-2360↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 12:51:18.412172 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:51:18.440516 run osmo-hlr_10.42.42.2(pid=7029): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7029)] 12:51:18.491288 run osmo-hlr_10.42.42.2(pid=7029): stdout: | (launched: 2022-12-09_12:51:15.168904) 12:51:18.543829 run osmo-hlr_10.42.42.2(pid=7029): stderr: | 20221209125115351 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125115351 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125115351 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125115352 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125115352 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125115352 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125115364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125115373 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125115373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125115373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:51:18.617485 run osmo-msc_10.42.42.6(pid=7035): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7035)] 12:51:18.668437 run osmo-msc_10.42.42.6(pid=7035): stdout: | (launched: 2022-12-09_12:51:17.440245) 12:51:18.720853 run osmo-msc_10.42.42.6(pid=7035): stderr: | 20221209125117764 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125117764 DLGLOBAL DEBUG validating counter group 0x7f1e6f2c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125117764 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125117764 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125117764 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125117764 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125117766 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125117767 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125117767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125117767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:51:18.773788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7028): Terminating (SIGTERM) 12:51:18.816423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7031): Terminating (SIGTERM) 12:51:18.859041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7034): Terminating (SIGTERM) 12:51:18.902088 --- ParallelTerminationStrategy: PID 7028 died... 12:51:18.922307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7028): Terminated: ok {rc=0} 12:51:18.969513 --- ParallelTerminationStrategy: PID 7031 died... 12:51:18.989164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7031): Terminated: ok {rc=0} 12:51:19.036104 --- ParallelTerminationStrategy: PID 7034 died... 12:51:19.055862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7034): Terminated: ok {rc=0} 12:51:19.145430 bus /sierra_3: Setting Powered False 12:51:20.245060 bus /sierra_3: Setting Powered False 12:51:21.360692 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 emergency:sysmo --------------------------------------------------------------------- 12:51:22.597361 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:51:22.601939 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 12:51:22.623418 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 12:51:22.651069 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 12:51:22.739652 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 12:51:22.761051 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 12:51:22.788729 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 12:51:23.373798 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2360 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 12:51:23.378995 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:51:23.390180 tst emergency:sysmo: Using 1 x bts (candidates: 1) 12:51:23.427445 tst emergency_mo_mt_call.py: using LAC 21582 12:51:23.551702 tst emergency_mo_mt_call.py: using RAC 162 12:51:23.673924 tst emergency_mo_mt_call.py: using CellId 21582 12:51:23.793856 tst emergency_mo_mt_call.py: using BVCI 21583 12:51:23.903678 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:51:23.914555 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:51:23.925376 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:51:23.935718 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:51:23.946200 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:51:23.956548 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:51:24.074359 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:51:24.195140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:51:24.704509 run create_hlr_db(pid=7043): Launched 12:51:24.831268 bus /sierra_2: Setting Powered False 12:51:25.896338 run create_hlr_db(pid=7043): Terminated: ok {rc=0} 12:51:26.335307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7045): Launched 12:51:26.644032 run osmo-hlr_10.42.42.2(pid=7046): Launched 12:51:26.761404 run osmo-stp_10.42.42.5: Starting osmo-stp 12:51:27.340411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7048): Launched 12:51:27.671739 run osmo-stp_10.42.42.5(pid=7049): Launched 12:51:27.807977 tst emergency_mo_mt_call.py: using MSISDN 7222 12:51:27.980432 run osmo-msc_10.42.42.6: Starting osmo-msc 12:51:28.569819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7051): Launched 12:51:28.899241 run osmo-msc_10.42.42.6(pid=7052): Launched 12:51:29.082582 run osmo-stp_10.42.42.5(pid=7049): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7049)] 12:51:29.220938 run osmo-stp_10.42.42.5(pid=7049): stdout: | (launched: 2022-12-09_12:51:27.610449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:29.359370 run osmo-stp_10.42.42.5(pid=7049): stderr: | 20221209125127804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125127805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125127805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125127805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125127806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125127806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125127806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:29.497198 run osmo-stp_10.42.42.5(pid=7049): stdout: | (launched: 2022-12-09_12:51:27.610449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:29.626765 run osmo-stp_10.42.42.5(pid=7049): stderr: | 20221209125127804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125127805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125127805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125127805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125127806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125127806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125127806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:29.781698 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7049): Process ended prematurely: osmo-stp_10.42.42.5(pid=7049) [trial-2360↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7049)] [trial-2360↪emergency:sysmo↪emergency_mo_mt_call.py:19] 12:51:29.790565 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 12:51:29.818508 run osmo-hlr_10.42.42.2(pid=7046): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7046)] 12:51:29.869375 run osmo-hlr_10.42.42.2(pid=7046): stdout: | (launched: 2022-12-09_12:51:26.586505) 12:51:29.922013 run osmo-hlr_10.42.42.2(pid=7046): stderr: | 20221209125126763 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125126763 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125126763 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125126764 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125126764 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125126764 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125126776 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125126787 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125126787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125126787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:51:29.995363 run osmo-msc_10.42.42.6(pid=7052): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7052)] 12:51:30.046567 run osmo-msc_10.42.42.6(pid=7052): stdout: | (launched: 2022-12-09_12:51:28.838160) 12:51:30.099478 run osmo-msc_10.42.42.6(pid=7052): stderr: | 20221209125129162 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125129162 DLGLOBAL DEBUG validating counter group 0x7fd2d0677c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125129162 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125129162 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125129162 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125129163 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125129166 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125129167 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125129167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125129167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:51:30.152925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7045): Terminating (SIGTERM) 12:51:30.195805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7048): Terminating (SIGTERM) 12:51:30.238457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7051): Terminating (SIGTERM) 12:51:30.281235 --- ParallelTerminationStrategy: PID 7045 died... 12:51:30.301412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7045): Terminated: ok {rc=0} 12:51:30.348350 --- ParallelTerminationStrategy: PID 7048 died... 12:51:30.368170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7048): Terminated: ok {rc=0} 12:51:30.415067 --- ParallelTerminationStrategy: PID 7051 died... 12:51:30.434811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7051): Terminated: ok {rc=0} 12:51:30.523979 bus /sierra_3: Setting Powered False 12:51:31.621610 bus /sierra_3: Setting Powered False 12:51:32.742117 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 12:51:33.830759 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:51:33.842307 tst emergency:sysmo: Using 1 x bts (candidates: 1) 12:51:33.880717 tst emergency_preemptive_call.py: using LAC 21583 12:51:34.005067 tst emergency_preemptive_call.py: using RAC 163 12:51:34.124506 tst emergency_preemptive_call.py: using CellId 21583 12:51:34.242290 tst emergency_preemptive_call.py: using BVCI 21584 12:51:34.352593 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:51:34.363329 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:51:34.373961 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:51:34.384499 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:51:34.395028 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:51:34.405524 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:51:34.520386 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:51:34.637345 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:51:34.753174 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:51:34.874829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:51:35.382412 run create_hlr_db(pid=7054): Launched 12:51:35.508378 bus /sierra_2: Setting Powered False 12:51:36.572453 run create_hlr_db(pid=7054): Terminated: ok {rc=0} 12:51:37.010670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7056): Launched 12:51:37.319765 run osmo-hlr_10.42.42.2(pid=7057): Launched 12:51:37.438734 run osmo-stp_10.42.42.5: Starting osmo-stp 12:51:37.982372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7059): Launched 12:51:38.290198 run osmo-stp_10.42.42.5(pid=7060): Launched 12:51:38.419898 tst emergency_preemptive_call.py: using MSISDN 7223 12:51:38.575343 run osmo-msc_10.42.42.6: Starting osmo-msc 12:51:39.122788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7062): Launched 12:51:39.429946 run osmo-msc_10.42.42.6(pid=7063): Launched 12:51:39.609774 run osmo-stp_10.42.42.5(pid=7060): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7060)] 12:51:39.738686 run osmo-stp_10.42.42.5(pid=7060): stdout: | (launched: 2022-12-09_12:51:38.232466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:39.867629 run osmo-stp_10.42.42.5(pid=7060): stderr: | 20221209125138405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125138405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125138405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125138405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125138406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125138406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125138406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:39.995663 run osmo-stp_10.42.42.5(pid=7060): stdout: | (launched: 2022-12-09_12:51:38.232466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:40.115851 run osmo-stp_10.42.42.5(pid=7060): stderr: | 20221209125138405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125138405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125138405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125138405 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125138406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125138406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125138406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:40.260423 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7060): Process ended prematurely: osmo-stp_10.42.42.5(pid=7060) [trial-2360↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7060)] [trial-2360↪emergency:sysmo↪emergency_preemptive_call.py:32] 12:51:40.268831 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 12:51:40.295143 run osmo-hlr_10.42.42.2(pid=7057): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7057)] 12:51:40.343218 run osmo-hlr_10.42.42.2(pid=7057): stdout: | (launched: 2022-12-09_12:51:37.261917) 12:51:40.393272 run osmo-hlr_10.42.42.2(pid=7057): stderr: | 20221209125137443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125137443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125137443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125137443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125137443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125137444 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125137456 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125137465 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125137465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125137465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:51:40.462562 run osmo-msc_10.42.42.6(pid=7063): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7063)] 12:51:40.510651 run osmo-msc_10.42.42.6(pid=7063): stdout: | (launched: 2022-12-09_12:51:39.371991) 12:51:40.560744 run osmo-msc_10.42.42.6(pid=7063): stderr: | 20221209125139645 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125139645 DLGLOBAL DEBUG validating counter group 0x7f2ffa762c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125139645 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125139645 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125139645 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125139645 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125139647 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125139648 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125139648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125139648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:51:40.610727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7056): Terminating (SIGTERM) 12:51:40.650673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7059): Terminating (SIGTERM) 12:51:40.690397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7062): Terminating (SIGTERM) 12:51:40.730335 --- ParallelTerminationStrategy: PID 7056 died... 12:51:40.749510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7056): Terminated: ok {rc=0} 12:51:40.793677 --- ParallelTerminationStrategy: PID 7059 died... 12:51:40.812459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7059): Terminated: ok {rc=0} 12:51:40.856326 --- ParallelTerminationStrategy: PID 7062 died... 12:51:40.874950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7062): Terminated: ok {rc=0} 12:51:40.962684 bus /sierra_9: Setting Powered False 12:51:42.064675 bus /sierra_9: Setting Powered False 12:51:43.182185 bus /sierra_8: Setting Powered False 12:51:44.280644 bus /sierra_8: Setting Powered False 12:51:45.397274 bus /sierra_3: Setting Powered False 12:51:46.503685 bus /sierra_3: Setting Powered False 12:51:47.619523 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:sysmo --------------------------------------------------------------------- 12:51:48.876482 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:51:48.882111 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 12:51:48.907053 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 12:51:48.947222 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 12:51:49.036291 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 12:51:49.058044 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 12:51:49.096365 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 12:51:49.692032 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 12:51:49.748801 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:51:49.760014 tst gprs:sysmo: Using 1 x bts (candidates: 1) 12:51:49.795851 tst cs_paging_gprs_active.py: using LAC 21584 12:51:49.925357 tst cs_paging_gprs_active.py: using RAC 164 12:51:50.054293 tst cs_paging_gprs_active.py: using CellId 21584 12:51:50.183127 tst cs_paging_gprs_active.py: using BVCI 21585 12:51:50.298405 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:51:50.309401 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:51:50.320015 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:51:50.330858 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:51:50.341645 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:51:50.352331 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:51:50.363210 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:51:50.374016 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:51:50.384700 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:51:50.505793 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:51:50.624748 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:51:50.834448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:51:51.149632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7068): Launched 12:51:51.421435 run iperf3-srv_10.42.42.10(pid=7069): Launched 12:51:51.538360 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:51:51.746861 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:51:52.059816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7070): Launched 12:51:52.333410 run iperf3-srv_10.42.42.10(pid=7071): Launched 12:51:52.451693 tst cs_paging_gprs_active.py:38: start network... 12:51:52.660163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:51:53.143892 run create_hlr_db(pid=7072): Launched 12:51:53.273632 bus /sierra_2: Setting Powered False 12:51:54.335725 run create_hlr_db(pid=7072): Terminated: ok {rc=0} 12:51:54.791017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7074): Launched 12:51:55.126144 run osmo-hlr_10.42.42.2(pid=7075): Launched 12:51:55.254880 run osmo-stp_10.42.42.5: Starting osmo-stp 12:51:55.828659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7077): Launched 12:51:56.163320 run osmo-stp_10.42.42.5(pid=7078): Launched 12:51:56.293076 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:51:57.871806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7080): Launched 12:51:57.999363 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:51:58.282378 run patchelf(pid=7081): Launched 12:51:58.468331 run osmo-stp_10.42.42.5(pid=7078): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7078)] 12:51:58.608466 run osmo-stp_10.42.42.5(pid=7078): stdout: | (launched: 2022-12-09_12:51:56.100878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:58.750434 run osmo-stp_10.42.42.5(pid=7078): stderr: | 20221209125156295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125156295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125156295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125156296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125156296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125156296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125156296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:58.892470 run osmo-stp_10.42.42.5(pid=7078): stdout: | (launched: 2022-12-09_12:51:56.100878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:51:59.028745 run osmo-stp_10.42.42.5(pid=7078): stderr: | 20221209125156295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125156295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125156295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125156296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125156296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125156296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125156296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:51:59.190774 run patchelf(pid=7081): Terminating (SIGINT) 12:51:59.375967 run patchelf(pid=7081): Terminated: ok {rc=0} 12:51:59.509718 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7078): Process ended prematurely: osmo-stp_10.42.42.5(pid=7078) [trial-2360↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7078)] [trial-2360↪gprs:sysmo↪cs_paging_gprs_active.py:38] 12:51:59.519797 tst cs_paging_gprs_active.py:38: Test FAILED (9.8 sec) 12:51:59.549011 run osmo-hlr_10.42.42.2(pid=7075): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7075)] 12:51:59.600017 run osmo-hlr_10.42.42.2(pid=7075): stdout: | (launched: 2022-12-09_12:51:55.063575) 12:51:59.652536 run osmo-hlr_10.42.42.2(pid=7075): stderr: | 20221209125155264 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125155264 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125155264 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125155264 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125155264 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125155264 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125155277 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125155285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125155286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125155286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:51:59.705757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7068): Terminating (SIGTERM) 12:51:59.748431 run iperf3-srv_10.42.42.10(pid=7069): Terminating (SIGTERM) 12:51:59.791079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7070): Terminating (SIGTERM) 12:51:59.833840 run iperf3-srv_10.42.42.10(pid=7071): Terminating (SIGTERM) 12:51:59.876304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7074): Terminating (SIGTERM) 12:51:59.918762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7077): Terminating (SIGTERM) 12:51:59.961307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7080): Terminating (SIGTERM) 12:52:00.003888 --- ParallelTerminationStrategy: PID 7068 died... 12:52:00.023929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7068): Terminated: ok {rc=0} 12:52:00.071346 --- ParallelTerminationStrategy: PID 7069 died... 12:52:00.091088 run iperf3-srv_10.42.42.10(pid=7069): Terminated {rc=256} 12:52:00.137959 --- ParallelTerminationStrategy: PID 7070 died... 12:52:00.157961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7070): Terminated: ok {rc=0} 12:52:00.205138 --- ParallelTerminationStrategy: PID 7071 died... 12:52:00.224774 run iperf3-srv_10.42.42.10(pid=7071): Terminated {rc=256} 12:52:00.271618 --- ParallelTerminationStrategy: PID 7074 died... 12:52:00.291893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7074): Terminated: ok {rc=0} 12:52:00.338794 --- ParallelTerminationStrategy: PID 7077 died... 12:52:00.358910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7077): Terminated: ok {rc=0} 12:52:00.406441 --- ParallelTerminationStrategy: PID 7080 died... 12:52:00.426305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7080): Terminated: ok {rc=0} 12:52:00.515724 bus /gobi_0: Setting Powered False 12:52:01.613551 bus /gobi_0: Setting Powered False 12:52:02.730314 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:sysmo iperf3.py ---------------------------------------------- 12:52:03.881470 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:03.892845 tst gprs:sysmo: Using 1 x bts (candidates: 1) 12:52:03.929556 tst iperf3.py: using LAC 21585 12:52:04.053965 tst iperf3.py: using RAC 165 12:52:04.178373 tst iperf3.py: using CellId 21585 12:52:04.302692 tst iperf3.py: using BVCI 21586 12:52:04.418111 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:04.428661 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:04.439354 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:04.449985 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:04.460354 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:04.470904 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:04.481625 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:04.492185 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:04.502894 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:52:04.617176 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:52:04.826746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:52:05.140087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7082): Launched 12:52:05.413412 run iperf3-srv_10.42.42.10(pid=7083): Launched 12:52:05.529495 tst iperf3.py:8: start network... 12:52:05.736162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:52:06.218979 run create_hlr_db(pid=7084): Launched 12:52:06.346774 bus /gobi_6: Setting Powered False 12:52:07.408463 run create_hlr_db(pid=7084): Terminated: ok {rc=0} 12:52:07.861523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7086): Launched 12:52:08.196812 run osmo-hlr_10.42.42.2(pid=7087): Launched 12:52:08.325079 run osmo-stp_10.42.42.5: Starting osmo-stp 12:52:08.901322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7089): Launched 12:52:09.235957 run osmo-stp_10.42.42.5(pid=7090): Launched 12:52:09.363958 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:52:09.936305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7092): Launched 12:52:10.065080 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:52:10.347403 run patchelf(pid=7093): Launched 12:52:10.531246 run osmo-stp_10.42.42.5(pid=7090): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7090)] 12:52:10.671987 run osmo-stp_10.42.42.5(pid=7090): stdout: | (launched: 2022-12-09_12:52:09.173962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:10.814104 run osmo-stp_10.42.42.5(pid=7090): stderr: | 20221209125209369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125209369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125209369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125209370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125209370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125209370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125209370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:10.956306 run osmo-stp_10.42.42.5(pid=7090): stdout: | (launched: 2022-12-09_12:52:09.173962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:11.093273 run osmo-stp_10.42.42.5(pid=7090): stderr: | 20221209125209369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125209369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125209369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125209370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125209370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125209370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125209370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:11.255766 run patchelf(pid=7093): Terminating (SIGINT) 12:52:11.441376 run patchelf(pid=7093): Terminated: ok {rc=0} 12:52:11.574482 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7090): Process ended prematurely: osmo-stp_10.42.42.5(pid=7090) [trial-2360↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7090)] [trial-2360↪gprs:sysmo↪iperf3.py:8] 12:52:11.584767 tst iperf3.py:8: Test FAILED (7.7 sec) 12:52:11.613928 run osmo-hlr_10.42.42.2(pid=7087): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7087)] 12:52:11.664249 run osmo-hlr_10.42.42.2(pid=7087): stdout: | (launched: 2022-12-09_12:52:08.134428) 12:52:11.716483 run osmo-hlr_10.42.42.2(pid=7087): stderr: | 20221209125208337 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125208337 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125208337 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125208337 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125208337 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125208337 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125208350 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125208358 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125208359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125208359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:52:11.769478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7082): Terminating (SIGTERM) 12:52:11.811967 run iperf3-srv_10.42.42.10(pid=7083): Terminating (SIGTERM) 12:52:11.854639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7086): Terminating (SIGTERM) 12:52:11.897501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7089): Terminating (SIGTERM) 12:52:11.940051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7092): Terminating (SIGTERM) 12:52:11.982893 --- ParallelTerminationStrategy: PID 7082 died... 12:52:12.003290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7082): Terminated: ok {rc=0} 12:52:12.050912 --- ParallelTerminationStrategy: PID 7083 died... 12:52:12.070912 run iperf3-srv_10.42.42.10(pid=7083): Terminated {rc=256} 12:52:12.118278 --- ParallelTerminationStrategy: PID 7086 died... 12:52:12.138290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7086): Terminated: ok {rc=0} 12:52:12.185751 --- ParallelTerminationStrategy: PID 7089 died... 12:52:12.205805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7089): Terminated: ok {rc=0} 12:52:12.252864 --- ParallelTerminationStrategy: PID 7092 died... 12:52:12.273256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7092): Terminated: ok {rc=0} 12:52:12.361971 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:sysmo iperf3m4.py ---------------------------------------------- 12:52:13.517012 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:13.529042 tst gprs:sysmo: Using 1 x bts (candidates: 1) 12:52:13.565185 tst iperf3m4.py: using LAC 21586 12:52:13.687840 tst iperf3m4.py: using RAC 166 12:52:13.810312 tst iperf3m4.py: using CellId 21586 12:52:13.932846 tst iperf3m4.py: using BVCI 21587 12:52:14.045841 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:14.056705 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:14.067526 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:14.078464 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:14.089495 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:14.099926 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:14.110610 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:14.120898 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:14.131586 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:52:14.252564 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:52:14.374491 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:52:14.494315 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:52:14.611298 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:52:14.820709 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:52:15.134766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7094): Launched 12:52:15.408641 run iperf3-srv_10.42.42.10(pid=7095): Launched 12:52:15.525603 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:52:15.733295 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:52:16.069666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7096): Launched 12:52:16.372321 run iperf3-srv_10.42.42.10(pid=7097): Launched 12:52:16.507654 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:52:16.721469 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:52:17.043870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7098): Launched 12:52:17.330337 run iperf3-srv_10.42.42.10(pid=7099): Launched 12:52:17.449287 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:52:17.657642 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:52:17.971216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7100): Launched 12:52:18.258488 run iperf3-srv_10.42.42.10(pid=7101): Launched 12:52:18.376733 tst iperf3m4.py:8: start network... 12:52:18.584155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:52:19.070092 run create_hlr_db(pid=7102): Launched 12:52:19.197350 bus /gobi_6: Setting Powered False 12:52:20.259580 run create_hlr_db(pid=7102): Terminated: ok {rc=0} 12:52:20.693842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7104): Launched 12:52:21.006999 run osmo-hlr_10.42.42.2(pid=7105): Launched 12:52:21.126645 run osmo-stp_10.42.42.5: Starting osmo-stp 12:52:21.680357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7107): Launched 12:52:21.993839 run osmo-stp_10.42.42.5(pid=7108): Launched 12:52:22.113876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:52:22.649824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7110): Launched 12:52:22.769739 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:52:23.034677 run patchelf(pid=7111): Launched 12:52:23.206957 run osmo-stp_10.42.42.5(pid=7108): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7108)] 12:52:23.338376 run osmo-stp_10.42.42.5(pid=7108): stdout: | (launched: 2022-12-09_12:52:21.935122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:23.471363 run osmo-stp_10.42.42.5(pid=7108): stderr: | 20221209125222112 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125222112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125222113 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125222113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125222113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125222114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125222114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:23.604147 run osmo-stp_10.42.42.5(pid=7108): stdout: | (launched: 2022-12-09_12:52:21.935122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:23.731702 run osmo-stp_10.42.42.5(pid=7108): stderr: | 20221209125222112 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125222112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125222113 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125222113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125222113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125222114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125222114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:23.882755 run patchelf(pid=7111): Terminating (SIGINT) 12:52:24.056665 run patchelf(pid=7111): Terminated: ok {rc=0} 12:52:24.181689 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7108): Process ended prematurely: osmo-stp_10.42.42.5(pid=7108) [trial-2360↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7108)] [trial-2360↪gprs:sysmo↪iperf3m4.py:8] 12:52:24.191211 tst iperf3m4.py:8: Test FAILED (10.7 sec) 12:52:24.218976 run osmo-hlr_10.42.42.2(pid=7105): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7105)] 12:52:24.267513 run osmo-hlr_10.42.42.2(pid=7105): stdout: | (launched: 2022-12-09_12:52:20.948213) 12:52:24.317735 run osmo-hlr_10.42.42.2(pid=7105): stderr: | 20221209125221130 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125221130 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125221130 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125221130 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125221130 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125221130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125221141 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125221149 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125221149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125221149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:52:24.368427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7094): Terminating (SIGTERM) 12:52:24.409254 run iperf3-srv_10.42.42.10(pid=7095): Terminating (SIGTERM) 12:52:24.450071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7096): Terminating (SIGTERM) 12:52:24.490896 run iperf3-srv_10.42.42.10(pid=7097): Terminating (SIGTERM) 12:52:24.531413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7098): Terminating (SIGTERM) 12:52:24.571964 run iperf3-srv_10.42.42.10(pid=7099): Terminating (SIGTERM) 12:52:24.612359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7100): Terminating (SIGTERM) 12:52:24.652854 run iperf3-srv_10.42.42.10(pid=7101): Terminating (SIGTERM) 12:52:24.693217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7104): Terminating (SIGTERM) 12:52:24.734061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7107): Terminating (SIGTERM) 12:52:24.774538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7110): Terminating (SIGTERM) 12:52:24.815351 --- ParallelTerminationStrategy: PID 7094 died... 12:52:24.834973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7094): Terminated: ok {rc=0} 12:52:24.880328 --- ParallelTerminationStrategy: PID 7095 died... 12:52:24.899649 run iperf3-srv_10.42.42.10(pid=7095): Terminated {rc=256} 12:52:24.944294 --- ParallelTerminationStrategy: PID 7096 died... 12:52:24.963300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7096): Terminated: ok {rc=0} 12:52:25.007863 --- ParallelTerminationStrategy: PID 7097 died... 12:52:25.026877 run iperf3-srv_10.42.42.10(pid=7097): Terminated {rc=256} 12:52:25.071480 --- ParallelTerminationStrategy: PID 7098 died... 12:52:25.090578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7098): Terminated: ok {rc=0} 12:52:25.135280 --- ParallelTerminationStrategy: PID 7099 died... 12:52:25.154335 run iperf3-srv_10.42.42.10(pid=7099): Terminated {rc=256} 12:52:25.198386 --- ParallelTerminationStrategy: PID 7100 died... 12:52:25.217306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7100): Terminated: ok {rc=0} 12:52:25.261334 --- ParallelTerminationStrategy: PID 7101 died... 12:52:25.280134 run iperf3-srv_10.42.42.10(pid=7101): Terminated {rc=256} 12:52:25.324153 --- ParallelTerminationStrategy: PID 7104 died... 12:52:25.343206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7104): Terminated: ok {rc=0} 12:52:25.387372 --- ParallelTerminationStrategy: PID 7107 died... 12:52:25.406297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7107): Terminated: ok {rc=0} 12:52:25.450586 --- ParallelTerminationStrategy: PID 7110 died... 12:52:25.469537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7110): Terminated: ok {rc=0} 12:52:25.555647 bus /gobi_4: Setting Powered False 12:52:26.655113 bus /gobi_4: Setting Powered False 12:52:27.772147 bus /gobi_1: Setting Powered False 12:52:28.871614 bus /gobi_1: Setting Powered False 12:52:29.988455 bus /gobi_0: Setting Powered False 12:52:31.096155 bus /gobi_0: Setting Powered False 12:52:32.236496 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:sysmo ping.py ---------------------------------------------- 12:52:33.340807 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:33.352240 tst gprs:sysmo: Using 1 x bts (candidates: 1) 12:52:33.388364 tst ping.py: using LAC 21587 12:52:33.509858 tst ping.py: using RAC 167 12:52:33.629045 tst ping.py: using CellId 21587 12:52:33.752849 tst ping.py: using BVCI 21588 12:52:33.864653 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:33.875339 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:33.885935 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:33.896390 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:33.906812 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:33.917182 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:33.927752 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:33.938583 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:52:34.052931 tst ping.py:19: start network... 12:52:34.256173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:52:34.730917 run create_hlr_db(pid=7112): Launched 12:52:34.855577 bus /gobi_6: Setting Powered False 12:52:35.915869 run create_hlr_db(pid=7112): Terminated: ok {rc=0} 12:52:36.363620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7116): Launched 12:52:36.693685 run osmo-hlr_10.42.42.2(pid=7117): Launched 12:52:36.819313 run osmo-stp_10.42.42.5: Starting osmo-stp 12:52:37.386801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7119): Launched 12:52:37.714619 run osmo-stp_10.42.42.5(pid=7120): Launched 12:52:37.839729 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:52:38.406120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7122): Launched 12:52:38.532558 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:52:38.810420 run patchelf(pid=7123): Launched 12:52:38.992196 run osmo-stp_10.42.42.5(pid=7120): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7120)] 12:52:39.131115 run osmo-stp_10.42.42.5(pid=7120): stdout: | (launched: 2022-12-09_12:52:37.653322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:39.271950 run osmo-stp_10.42.42.5(pid=7120): stderr: | 20221209125237848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125237848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125237848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125237848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125237849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125237849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125237849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:39.412514 run osmo-stp_10.42.42.5(pid=7120): stdout: | (launched: 2022-12-09_12:52:37.653322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:39.546731 run osmo-stp_10.42.42.5(pid=7120): stderr: | 20221209125237848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125237848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125237848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125237848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125237849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125237849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125237849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:39.706161 run patchelf(pid=7123): Terminating (SIGINT) 12:52:39.888469 run patchelf(pid=7123): Terminated: ok {rc=0} 12:52:40.021112 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7120): Process ended prematurely: osmo-stp_10.42.42.5(pid=7120) [trial-2360↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7120)] [trial-2360↪gprs:sysmo↪ping.py:22] 12:52:40.030628 tst ping.py:22: Test FAILED (6.7 sec) 12:52:40.061408 run osmo-hlr_10.42.42.2(pid=7117): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7117)] 12:52:40.114963 run osmo-hlr_10.42.42.2(pid=7117): stdout: | (launched: 2022-12-09_12:52:36.632127) 12:52:40.167911 run osmo-hlr_10.42.42.2(pid=7117): stderr: | 20221209125236832 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125236832 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125236832 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125236832 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125236832 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125236832 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125236845 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125236853 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125236853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125236853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:52:40.221246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7116): Terminating (SIGTERM) 12:52:40.264294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7119): Terminating (SIGTERM) 12:52:40.307313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7122): Terminating (SIGTERM) 12:52:40.350598 --- ParallelTerminationStrategy: PID 7116 died... 12:52:40.371049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7116): Terminated: ok {rc=0} 12:52:40.418393 --- ParallelTerminationStrategy: PID 7119 died... 12:52:40.438218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7119): Terminated: ok {rc=0} 12:52:40.485262 --- ParallelTerminationStrategy: PID 7122 died... 12:52:40.505088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7122): Terminated: ok {rc=0} 12:52:40.594930 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 12:52:41.684110 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:41.696290 tst gprs:sysmo: Using 1 x bts (candidates: 1) 12:52:41.734670 tst ping_idle_ping.py: using LAC 21588 12:52:41.862755 tst ping_idle_ping.py: using RAC 168 12:52:41.991473 tst ping_idle_ping.py: using CellId 21588 12:52:42.112683 tst ping_idle_ping.py: using BVCI 21589 12:52:42.223624 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:42.234531 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:42.245237 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:42.255988 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:42.266722 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:42.277455 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:42.288120 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:52:42.298709 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:52:42.424924 tst ping_idle_ping.py:24: start network... 12:52:42.645550 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:52:43.152731 run create_hlr_db(pid=7125): Launched 12:52:43.280392 bus /gobi_6: Setting Powered False 12:52:44.341521 run create_hlr_db(pid=7125): Terminated: ok {rc=0} 12:52:44.778861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7127): Launched 12:52:45.088625 run osmo-hlr_10.42.42.2(pid=7128): Launched 12:52:45.206062 run osmo-stp_10.42.42.5: Starting osmo-stp 12:52:45.732585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7130): Launched 12:52:46.067302 run osmo-stp_10.42.42.5(pid=7131): Launched 12:52:46.207220 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:52:46.912396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7133): Launched 12:52:47.053664 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:52:47.317633 run patchelf(pid=7134): Launched 12:52:47.500292 run osmo-stp_10.42.42.5(pid=7131): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7131)] 12:52:47.639557 run osmo-stp_10.42.42.5(pid=7131): stdout: | (launched: 2022-12-09_12:52:46.008019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:47.779939 run osmo-stp_10.42.42.5(pid=7131): stderr: | 20221209125246363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125246363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125246364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125246364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125246364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125246373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125246373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:47.920354 run osmo-stp_10.42.42.5(pid=7131): stdout: | (launched: 2022-12-09_12:52:46.008019) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:48.054589 run osmo-stp_10.42.42.5(pid=7131): stderr: | 20221209125246363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125246363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125246364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125246364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125246364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125246373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125246373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:48.214336 run patchelf(pid=7134): Terminating (SIGINT) 12:52:48.397323 run patchelf(pid=7134): Terminated: ok {rc=0} 12:52:48.528939 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7131): Process ended prematurely: osmo-stp_10.42.42.5(pid=7131) [trial-2360↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7131)] [trial-2360↪gprs:sysmo↪ping_idle_ping.py:27] 12:52:48.538698 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:52:48.567409 run osmo-hlr_10.42.42.2(pid=7128): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7128)] 12:52:48.618131 run osmo-hlr_10.42.42.2(pid=7128): stdout: | (launched: 2022-12-09_12:52:45.030112) 12:52:48.670619 run osmo-hlr_10.42.42.2(pid=7128): stderr: | 20221209125245210 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125245210 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125245210 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125245211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125245211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125245211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125245223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125245232 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125245232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125245232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:52:48.723720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7127): Terminating (SIGTERM) 12:52:48.766503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7130): Terminating (SIGTERM) 12:52:48.809103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7133): Terminating (SIGTERM) 12:52:48.851724 --- ParallelTerminationStrategy: PID 7127 died... 12:52:48.871909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7127): Terminated: ok {rc=0} 12:52:48.919092 --- ParallelTerminationStrategy: PID 7130 died... 12:52:48.938825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7130): Terminated: ok {rc=0} 12:52:48.985860 --- ParallelTerminationStrategy: PID 7133 died... 12:52:49.005488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7133): Terminated: ok {rc=0} 12:52:49.094027 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 12:52:50.380381 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:52:50.385660 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:52:50.406535 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:52:50.444767 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:52:50.531895 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:52:50.552559 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:52:50.590800 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:52:51.185214 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:52:51.234541 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:52:51.245356 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:52:51.282290 tst cs_paging_gprs_active.py: using LAC 21589 12:52:51.404134 tst cs_paging_gprs_active.py: using RAC 169 12:52:51.527161 tst cs_paging_gprs_active.py: using CellId 21589 12:52:51.650976 tst cs_paging_gprs_active.py: using BVCI 21590 12:52:51.765693 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:52:51.776551 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:52:51.787220 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:52:51.797844 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:52:51.808363 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:52:51.819061 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:52:51.829843 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:52:51.840336 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:52:51.851112 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:52:51.970487 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:52:52.090603 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:52:52.299816 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:52:52.612406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7138): Launched 12:52:52.886007 run iperf3-srv_10.42.42.10(pid=7139): Launched 12:52:53.002642 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:52:53.212176 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:52:53.526360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7140): Launched 12:52:53.800320 run iperf3-srv_10.42.42.10(pid=7141): Launched 12:52:53.919431 tst cs_paging_gprs_active.py:38: start network... 12:52:54.128213 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:52:54.613500 run create_hlr_db(pid=7142): Launched 12:52:54.742143 bus /gobi_6: Setting Powered False 12:52:55.804017 run create_hlr_db(pid=7142): Terminated: ok {rc=0} 12:52:56.260703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7144): Launched 12:52:56.598441 run osmo-hlr_10.42.42.2(pid=7145): Launched 12:52:56.727984 run osmo-stp_10.42.42.5: Starting osmo-stp 12:52:57.307976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7147): Launched 12:52:57.643929 run osmo-stp_10.42.42.5(pid=7148): Launched 12:52:57.773220 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:52:58.350609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7150): Launched 12:52:58.478216 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:52:58.760918 run patchelf(pid=7151): Launched 12:52:58.947031 run osmo-stp_10.42.42.5(pid=7148): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7148)] 12:52:59.088023 run osmo-stp_10.42.42.5(pid=7148): stdout: | (launched: 2022-12-09_12:52:57.581855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:59.230839 run osmo-stp_10.42.42.5(pid=7148): stderr: | 20221209125257778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125257778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125257778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125257779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125257779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125257779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125257779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:59.373252 run osmo-stp_10.42.42.5(pid=7148): stdout: | (launched: 2022-12-09_12:52:57.581855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:52:59.509838 run osmo-stp_10.42.42.5(pid=7148): stderr: | 20221209125257778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125257778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125257778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125257779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125257779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125257779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125257779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:52:59.671441 run patchelf(pid=7151): Terminating (SIGINT) 12:52:59.857063 run patchelf(pid=7151): Terminated: ok {rc=0} 12:52:59.990846 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7148): Process ended prematurely: osmo-stp_10.42.42.5(pid=7148) [trial-2360↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7148)] [trial-2360↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:53:00.001277 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:53:00.030830 run osmo-hlr_10.42.42.2(pid=7145): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7145)] 12:53:00.082101 run osmo-hlr_10.42.42.2(pid=7145): stdout: | (launched: 2022-12-09_12:52:56.536086) 12:53:00.135274 run osmo-hlr_10.42.42.2(pid=7145): stderr: | 20221209125256740 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125256740 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125256740 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125256740 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125256740 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125256740 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125256757 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125256767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125256767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125256767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:53:00.188883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7138): Terminating (SIGTERM) 12:53:00.232025 run iperf3-srv_10.42.42.10(pid=7139): Terminating (SIGTERM) 12:53:00.275409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7140): Terminating (SIGTERM) 12:53:00.318687 run iperf3-srv_10.42.42.10(pid=7141): Terminating (SIGTERM) 12:53:00.361487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7144): Terminating (SIGTERM) 12:53:00.404454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7147): Terminating (SIGTERM) 12:53:00.447458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7150): Terminating (SIGTERM) 12:53:00.491118 --- ParallelTerminationStrategy: PID 7138 died... 12:53:00.511717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7138): Terminated: ok {rc=0} 12:53:00.558895 --- ParallelTerminationStrategy: PID 7139 died... 12:53:00.578508 run iperf3-srv_10.42.42.10(pid=7139): Terminated {rc=256} 12:53:00.625215 --- ParallelTerminationStrategy: PID 7140 died... 12:53:00.644724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7140): Terminated: ok {rc=0} 12:53:00.691330 --- ParallelTerminationStrategy: PID 7141 died... 12:53:00.710884 run iperf3-srv_10.42.42.10(pid=7141): Terminated {rc=256} 12:53:00.757266 --- ParallelTerminationStrategy: PID 7144 died... 12:53:00.776792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7144): Terminated: ok {rc=0} 12:53:00.823090 --- ParallelTerminationStrategy: PID 7147 died... 12:53:00.843167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7147): Terminated: ok {rc=0} 12:53:00.900305 --- ParallelTerminationStrategy: PID 7150 died... 12:53:00.921259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7150): Terminated: ok {rc=0} 12:53:01.009870 bus /gobi_0: Setting Powered False 12:53:02.133878 bus /gobi_0: Setting Powered False 12:53:03.288314 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:53:04.456434 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:04.470089 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:53:04.512222 tst iperf3.py: using LAC 21590 12:53:04.647573 tst iperf3.py: using RAC 170 12:53:04.783170 tst iperf3.py: using CellId 21590 12:53:04.917450 tst iperf3.py: using BVCI 21591 12:53:05.045565 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:05.057912 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:05.071881 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:05.087800 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:05.101158 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:05.114517 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:05.126864 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:05.140035 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:05.154613 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:53:05.283670 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:53:05.513440 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:53:05.853609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7424): Launched 12:53:06.147542 run iperf3-srv_10.42.42.10(pid=7425): Launched 12:53:06.281473 tst iperf3.py:8: start network... 12:53:06.491876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:53:06.982704 run create_hlr_db(pid=7426): Launched 12:53:07.142284 bus /gobi_6: Setting Powered False 12:53:08.204122 run create_hlr_db(pid=7426): Terminated: ok {rc=0} 12:53:08.649993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7428): Launched 12:53:08.983597 run osmo-hlr_10.42.42.2(pid=7429): Launched 12:53:09.237790 run osmo-stp_10.42.42.5: Starting osmo-stp 12:53:09.969677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7431): Launched 12:53:10.303867 run osmo-stp_10.42.42.5(pid=7432): Launched 12:53:10.551809 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:53:11.271241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7434): Launched 12:53:11.411337 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:53:11.699505 run patchelf(pid=7435): Launched 12:53:11.900358 run osmo-stp_10.42.42.5(pid=7432): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7432)] 12:53:12.044844 run osmo-stp_10.42.42.5(pid=7432): stdout: | (launched: 2022-12-09_12:53:10.242616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:12.191583 run osmo-stp_10.42.42.5(pid=7432): stderr: | 20221209125310581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125310582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125310582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125310582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125310583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125310583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125310583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:12.338143 run osmo-stp_10.42.42.5(pid=7432): stdout: | (launched: 2022-12-09_12:53:10.242616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:12.478919 run osmo-stp_10.42.42.5(pid=7432): stderr: | 20221209125310581 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125310582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125310582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125310582 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125310583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125310583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125310583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:12.645639 run patchelf(pid=7435): Terminating (SIGINT) 12:53:12.836024 run patchelf(pid=7435): Terminated: ok {rc=0} 12:53:12.973816 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7432): Process ended prematurely: osmo-stp_10.42.42.5(pid=7432) [trial-2360↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7432)] [trial-2360↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 12:53:12.985432 tst iperf3.py:8: Test FAILED (8.6 sec) 12:53:13.018430 run osmo-hlr_10.42.42.2(pid=7429): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7429)] 12:53:13.072538 run osmo-hlr_10.42.42.2(pid=7429): stdout: | (launched: 2022-12-09_12:53:08.922998) 12:53:13.128203 run osmo-hlr_10.42.42.2(pid=7429): stderr: | 20221209125309271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125309271 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125309271 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125309271 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125309271 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125309272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125309288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125309305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125309305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125309305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:53:13.185110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7424): Terminating (SIGTERM) 12:53:13.231359 run iperf3-srv_10.42.42.10(pid=7425): Terminating (SIGTERM) 12:53:13.278315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7428): Terminating (SIGTERM) 12:53:13.324324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7431): Terminating (SIGTERM) 12:53:13.371744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7434): Terminating (SIGTERM) 12:53:13.419101 --- ParallelTerminationStrategy: PID 7424 died... 12:53:13.440558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7424): Terminated: ok {rc=0} 12:53:13.492515 --- ParallelTerminationStrategy: PID 7425 died... 12:53:13.513555 run iperf3-srv_10.42.42.10(pid=7425): Terminated {rc=256} 12:53:13.563905 --- ParallelTerminationStrategy: PID 7428 died... 12:53:13.585268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7428): Terminated: ok {rc=0} 12:53:13.635766 --- ParallelTerminationStrategy: PID 7431 died... 12:53:13.656911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7431): Terminated: ok {rc=0} 12:53:13.707552 --- ParallelTerminationStrategy: PID 7434 died... 12:53:13.728705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7434): Terminated: ok {rc=0} 12:53:13.822428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:53:14.984174 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:14.997595 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:53:15.038324 tst iperf3m4.py: using LAC 21591 12:53:15.175659 tst iperf3m4.py: using RAC 171 12:53:15.313450 tst iperf3m4.py: using CellId 21591 12:53:15.450096 tst iperf3m4.py: using BVCI 21592 12:53:15.577779 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:15.590433 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:15.604488 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:15.617969 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:15.630598 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:15.643867 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:15.658474 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:15.672250 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:15.686595 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:53:15.813093 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:53:15.950075 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:53:16.077846 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:53:16.207647 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:53:16.443639 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:53:16.793018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7436): Launched 12:53:17.106829 run iperf3-srv_10.42.42.10(pid=7437): Launched 12:53:17.250332 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:53:17.483211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:53:17.830936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7438): Launched 12:53:18.141384 run iperf3-srv_10.42.42.10(pid=7439): Launched 12:53:18.286343 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:53:18.519208 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:53:18.866661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7440): Launched 12:53:19.178289 run iperf3-srv_10.42.42.10(pid=7441): Launched 12:53:19.322548 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:53:19.555300 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:53:19.904213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7442): Launched 12:53:20.215278 run iperf3-srv_10.42.42.10(pid=7443): Launched 12:53:20.361955 tst iperf3m4.py:8: start network... 12:53:20.598598 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:53:21.133969 run create_hlr_db(pid=7444): Launched 12:53:21.305904 bus /gobi_6: Setting Powered False 12:53:22.372934 run create_hlr_db(pid=7444): Terminated: ok {rc=0} 12:53:22.853113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7446): Launched 12:53:23.210448 run osmo-hlr_10.42.42.2(pid=7447): Launched 12:53:23.470598 run osmo-stp_10.42.42.5: Starting osmo-stp 12:53:24.162178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7449): Launched 12:53:24.525757 run osmo-stp_10.42.42.5(pid=7450): Launched 12:53:24.644907 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:53:25.183434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7452): Launched 12:53:25.303371 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:53:25.569009 run patchelf(pid=7453): Launched 12:53:25.741346 run osmo-stp_10.42.42.5(pid=7450): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7450)] 12:53:25.872385 run osmo-stp_10.42.42.5(pid=7450): stdout: | (launched: 2022-12-09_12:53:24.456442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:26.004812 run osmo-stp_10.42.42.5(pid=7450): stderr: | 20221209125324643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125324643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125324643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125324644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125324644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125324644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125324644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:26.137829 run osmo-stp_10.42.42.5(pid=7450): stdout: | (launched: 2022-12-09_12:53:24.456442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:26.264769 run osmo-stp_10.42.42.5(pid=7450): stderr: | 20221209125324643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125324643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125324643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125324644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125324644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125324644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125324644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:26.415446 run patchelf(pid=7453): Terminating (SIGINT) 12:53:26.588435 run patchelf(pid=7453): Terminated: ok {rc=0} 12:53:26.712694 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7450): Process ended prematurely: osmo-stp_10.42.42.5(pid=7450) [trial-2360↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7450)] [trial-2360↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 12:53:26.722273 tst iperf3m4.py:8: Test FAILED (11.8 sec) 12:53:26.749985 run osmo-hlr_10.42.42.2(pid=7447): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7447)] 12:53:26.798300 run osmo-hlr_10.42.42.2(pid=7447): stdout: | (launched: 2022-12-09_12:53:23.146676) 12:53:26.848342 run osmo-hlr_10.42.42.2(pid=7447): stderr: | 20221209125323463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125323463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125323463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125323463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125323463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125323463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125323477 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125323491 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125323491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125323491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:53:26.898853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7436): Terminating (SIGTERM) 12:53:26.939180 run iperf3-srv_10.42.42.10(pid=7437): Terminating (SIGTERM) 12:53:26.979332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7438): Terminating (SIGTERM) 12:53:27.019642 run iperf3-srv_10.42.42.10(pid=7439): Terminating (SIGTERM) 12:53:27.059663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7440): Terminating (SIGTERM) 12:53:27.099798 run iperf3-srv_10.42.42.10(pid=7441): Terminating (SIGTERM) 12:53:27.139862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7442): Terminating (SIGTERM) 12:53:27.180068 run iperf3-srv_10.42.42.10(pid=7443): Terminating (SIGTERM) 12:53:27.220019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7446): Terminating (SIGTERM) 12:53:27.260214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7449): Terminating (SIGTERM) 12:53:27.300879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7452): Terminating (SIGTERM) 12:53:27.341327 --- ParallelTerminationStrategy: PID 7436 died... 12:53:27.360650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7436): Terminated: ok {rc=0} 12:53:27.405835 --- ParallelTerminationStrategy: PID 7437 died... 12:53:27.424631 run iperf3-srv_10.42.42.10(pid=7437): Terminated {rc=256} 12:53:27.468676 --- ParallelTerminationStrategy: PID 7438 died... 12:53:27.487608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7438): Terminated: ok {rc=0} 12:53:27.531905 --- ParallelTerminationStrategy: PID 7439 died... 12:53:27.550595 run iperf3-srv_10.42.42.10(pid=7439): Terminated {rc=256} 12:53:27.594428 --- ParallelTerminationStrategy: PID 7440 died... 12:53:27.613266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7440): Terminated: ok {rc=0} 12:53:27.657322 --- ParallelTerminationStrategy: PID 7441 died... 12:53:27.676201 run iperf3-srv_10.42.42.10(pid=7441): Terminated {rc=256} 12:53:27.720845 --- ParallelTerminationStrategy: PID 7442 died... 12:53:27.740091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7442): Terminated: ok {rc=0} 12:53:27.784097 --- ParallelTerminationStrategy: PID 7443 died... 12:53:27.802853 run iperf3-srv_10.42.42.10(pid=7443): Terminated {rc=256} 12:53:27.847855 --- ParallelTerminationStrategy: PID 7446 died... 12:53:27.867005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7446): Terminated: ok {rc=0} 12:53:27.911382 --- ParallelTerminationStrategy: PID 7449 died... 12:53:27.930424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7449): Terminated: ok {rc=0} 12:53:27.974716 --- ParallelTerminationStrategy: PID 7452 died... 12:53:27.994128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7452): Terminated: ok {rc=0} 12:53:28.079950 bus /gobi_4: Setting Powered False 12:53:29.182525 bus /gobi_4: Setting Powered False 12:53:30.299796 bus /gobi_1: Setting Powered False 12:53:31.408121 bus /gobi_1: Setting Powered False 12:53:32.529009 bus /gobi_0: Setting Powered False 12:53:33.630722 bus /gobi_0: Setting Powered False 12:53:34.748738 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 12:53:35.853508 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:35.866132 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:53:35.906419 tst ping.py: using LAC 21592 12:53:36.035744 tst ping.py: using RAC 172 12:53:36.163907 tst ping.py: using CellId 21592 12:53:36.293930 tst ping.py: using BVCI 21593 12:53:36.413250 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:36.424541 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:36.435820 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:36.447381 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:36.458763 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:36.470016 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:36.481544 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:36.492927 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:53:36.613400 tst ping.py:19: start network... 12:53:36.818477 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:53:37.293543 run create_hlr_db(pid=7454): Launched 12:53:37.420464 bus /gobi_6: Setting Powered False 12:53:38.481829 run create_hlr_db(pid=7454): Terminated: ok {rc=0} 12:53:38.910347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7456): Launched 12:53:39.216894 run osmo-hlr_10.42.42.2(pid=7457): Launched 12:53:39.332316 run osmo-stp_10.42.42.5: Starting osmo-stp 12:53:39.879693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7459): Launched 12:53:40.187914 run osmo-stp_10.42.42.5(pid=7460): Launched 12:53:40.305335 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:53:40.833445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7462): Launched 12:53:40.949985 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:53:41.209099 run patchelf(pid=7463): Launched 12:53:41.378857 run osmo-stp_10.42.42.5(pid=7460): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7460)] 12:53:41.508479 run osmo-stp_10.42.42.5(pid=7460): stdout: | (launched: 2022-12-09_12:53:40.130557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:41.638836 run osmo-stp_10.42.42.5(pid=7460): stderr: | 20221209125340305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125340305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125340305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125340306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125340306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125340306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125340306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:41.769108 run osmo-stp_10.42.42.5(pid=7460): stdout: | (launched: 2022-12-09_12:53:40.130557) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:41.894122 run osmo-stp_10.42.42.5(pid=7460): stderr: | 20221209125340305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125340305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125340305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125340306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125340306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125340306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125340306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:42.042005 run patchelf(pid=7463): Terminating (SIGINT) 12:53:42.211988 run patchelf(pid=7463): Terminated: ok {rc=0} 12:53:42.334073 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7460): Process ended prematurely: osmo-stp_10.42.42.5(pid=7460) [trial-2360↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7460)] [trial-2360↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 12:53:42.342983 tst ping.py:22: Test FAILED (6.5 sec) 12:53:42.370274 run osmo-hlr_10.42.42.2(pid=7457): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7457)] 12:53:42.418248 run osmo-hlr_10.42.42.2(pid=7457): stdout: | (launched: 2022-12-09_12:53:39.159126) 12:53:42.467850 run osmo-hlr_10.42.42.2(pid=7457): stderr: | 20221209125339339 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125339339 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125339339 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125339339 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125339340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125339340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125339352 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125339361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125339361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125339361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:53:42.518124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7456): Terminating (SIGTERM) 12:53:42.558439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7459): Terminating (SIGTERM) 12:53:42.598679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7462): Terminating (SIGTERM) 12:53:42.639677 --- ParallelTerminationStrategy: PID 7456 died... 12:53:42.659318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7456): Terminated: ok {rc=0} 12:53:42.705062 --- ParallelTerminationStrategy: PID 7459 died... 12:53:42.724303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7459): Terminated: ok {rc=0} 12:53:42.769552 --- ParallelTerminationStrategy: PID 7462 died... 12:53:42.788766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7462): Terminated: ok {rc=0} 12:53:42.876420 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:53:43.967237 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:43.979516 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:53:44.022506 tst ping_idle_ping.py: using LAC 21593 12:53:44.150522 tst ping_idle_ping.py: using RAC 173 12:53:44.277792 tst ping_idle_ping.py: using CellId 21593 12:53:44.404772 tst ping_idle_ping.py: using BVCI 21594 12:53:44.523909 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:44.535458 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:44.546931 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:44.558492 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:44.569870 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:44.581275 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:44.592712 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:53:44.604031 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:53:44.728048 tst ping_idle_ping.py:24: start network... 12:53:44.950214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:53:45.458974 run create_hlr_db(pid=7464): Launched 12:53:45.585384 bus /gobi_6: Setting Powered False 12:53:46.657453 run create_hlr_db(pid=7464): Terminated: ok {rc=0} 12:53:47.168252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7466): Launched 12:53:47.508464 run osmo-hlr_10.42.42.2(pid=7467): Launched 12:53:47.634404 run osmo-stp_10.42.42.5: Starting osmo-stp 12:53:48.200729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7469): Launched 12:53:48.530700 run osmo-stp_10.42.42.5(pid=7470): Launched 12:53:48.655591 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:53:49.224053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7472): Launched 12:53:49.350557 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:53:49.628808 run patchelf(pid=7473): Launched 12:53:49.811953 run osmo-stp_10.42.42.5(pid=7470): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7470)] 12:53:49.950696 run osmo-stp_10.42.42.5(pid=7470): stdout: | (launched: 2022-12-09_12:53:48.469508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:50.091097 run osmo-stp_10.42.42.5(pid=7470): stderr: | 20221209125348661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125348661 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125348661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125348662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125348662 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125348662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125348662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:50.231532 run osmo-stp_10.42.42.5(pid=7470): stdout: | (launched: 2022-12-09_12:53:48.469508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:53:50.366125 run osmo-stp_10.42.42.5(pid=7470): stderr: | 20221209125348661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125348661 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125348661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125348662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125348662 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125348662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125348662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:53:50.524893 run patchelf(pid=7473): Terminating (SIGINT) 12:53:50.707551 run patchelf(pid=7473): Terminated: ok {rc=0} 12:53:50.838722 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7470): Process ended prematurely: osmo-stp_10.42.42.5(pid=7470) [trial-2360↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7470)] [trial-2360↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 12:53:50.848364 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 12:53:50.877145 run osmo-hlr_10.42.42.2(pid=7467): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7467)] 12:53:50.927790 run osmo-hlr_10.42.42.2(pid=7467): stdout: | (launched: 2022-12-09_12:53:47.447139) 12:53:50.980151 run osmo-hlr_10.42.42.2(pid=7467): stderr: | 20221209125347648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125347648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125347648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125347648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125347648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125347648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125347660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125347669 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125347669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125347669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:53:51.034488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7466): Terminating (SIGTERM) 12:53:51.077046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7469): Terminating (SIGTERM) 12:53:51.120537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7472): Terminating (SIGTERM) 12:53:51.163897 --- ParallelTerminationStrategy: PID 7466 died... 12:53:51.184126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7466): Terminated: ok {rc=0} 12:53:51.231654 --- ParallelTerminationStrategy: PID 7469 died... 12:53:51.251633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7469): Terminated: ok {rc=0} 12:53:51.299110 --- ParallelTerminationStrategy: PID 7472 died... 12:53:51.319123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7472): Terminated: ok {rc=0} 12:53:51.407776 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:53:52.702393 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:53:52.709614 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:53:52.730762 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:53:52.770456 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:53:52.858053 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:53:52.879206 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:53:52.918336 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:53:53.510567 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:53:53.561090 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:53:53.572091 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:53:53.629769 tst cs_paging_gprs_active.py: using LAC 21594 12:53:53.752276 tst cs_paging_gprs_active.py: using RAC 174 12:53:53.876157 tst cs_paging_gprs_active.py: using CellId 21594 12:53:54.009168 tst cs_paging_gprs_active.py: using BVCI 21595 12:53:54.131943 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:53:54.143574 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:53:54.155025 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:53:54.166686 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:53:54.178306 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:53:54.189856 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:53:54.201817 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:53:54.213281 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:53:54.224999 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:53:54.342973 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:53:54.464379 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:53:54.689889 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:53:55.024800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7477): Launched 12:53:55.317191 run iperf3-srv_10.42.42.10(pid=7478): Launched 12:53:55.443446 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:53:55.667978 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:53:56.002795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7479): Launched 12:53:56.294482 run iperf3-srv_10.42.42.10(pid=7480): Launched 12:53:56.421234 tst cs_paging_gprs_active.py:38: start network... 12:53:56.645856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:53:57.163894 run create_hlr_db(pid=7481): Launched 12:53:57.292058 bus /gobi_6: Setting Powered False 12:53:58.358281 run create_hlr_db(pid=7481): Terminated: ok {rc=0} 12:53:58.802980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7483): Launched 12:53:59.117821 run osmo-hlr_10.42.42.2(pid=7484): Launched 12:53:59.236662 run osmo-stp_10.42.42.5: Starting osmo-stp 12:53:59.774425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7486): Launched 12:54:00.087971 run osmo-stp_10.42.42.5(pid=7487): Launched 12:54:00.206674 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:54:00.747732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7489): Launched 12:54:00.891729 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:54:01.185652 run patchelf(pid=7490): Launched 12:54:01.414603 run osmo-stp_10.42.42.5(pid=7487): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7487)] 12:54:01.551603 run osmo-stp_10.42.42.5(pid=7487): stdout: | (launched: 2022-12-09_12:54:00.029261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:01.689553 run osmo-stp_10.42.42.5(pid=7487): stderr: | 20221209125400204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125400205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125400205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125400206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125400206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125400206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125400206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:01.825235 run osmo-stp_10.42.42.5(pid=7487): stdout: | (launched: 2022-12-09_12:54:00.029261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:01.955299 run osmo-stp_10.42.42.5(pid=7487): stderr: | 20221209125400204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125400205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125400205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125400206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125400206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125400206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125400206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:02.109703 run patchelf(pid=7490): Terminating (SIGINT) 12:54:02.285324 run patchelf(pid=7490): Terminated: ok {rc=0} 12:54:02.410554 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7487): Process ended prematurely: osmo-stp_10.42.42.5(pid=7487) [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7487)] [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:54:02.419982 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 12:54:02.447535 run osmo-hlr_10.42.42.2(pid=7484): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7484)] 12:54:02.495879 run osmo-hlr_10.42.42.2(pid=7484): stdout: | (launched: 2022-12-09_12:53:59.058984) 12:54:02.545897 run osmo-hlr_10.42.42.2(pid=7484): stderr: | 20221209125359241 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125359241 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125359241 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125359241 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125359241 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125359241 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125359292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125359302 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125359302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125359302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:54:02.596531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7477): Terminating (SIGTERM) 12:54:02.637176 run iperf3-srv_10.42.42.10(pid=7478): Terminating (SIGTERM) 12:54:02.677678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7479): Terminating (SIGTERM) 12:54:02.718044 run iperf3-srv_10.42.42.10(pid=7480): Terminating (SIGTERM) 12:54:02.758469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7483): Terminating (SIGTERM) 12:54:02.798879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7486): Terminating (SIGTERM) 12:54:02.839207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7489): Terminating (SIGTERM) 12:54:02.879798 --- ParallelTerminationStrategy: PID 7477 died... 12:54:02.899299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7477): Terminated: ok {rc=0} 12:54:02.944094 --- ParallelTerminationStrategy: PID 7478 died... 12:54:02.963098 run iperf3-srv_10.42.42.10(pid=7478): Terminated {rc=256} 12:54:03.007496 --- ParallelTerminationStrategy: PID 7479 died... 12:54:03.026584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7479): Terminated: ok {rc=0} 12:54:03.070933 --- ParallelTerminationStrategy: PID 7480 died... 12:54:03.089959 run iperf3-srv_10.42.42.10(pid=7480): Terminated {rc=256} 12:54:03.134432 --- ParallelTerminationStrategy: PID 7483 died... 12:54:03.153567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7483): Terminated: ok {rc=0} 12:54:03.198013 --- ParallelTerminationStrategy: PID 7486 died... 12:54:03.217125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7486): Terminated: ok {rc=0} 12:54:03.261595 --- ParallelTerminationStrategy: PID 7489 died... 12:54:03.280382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7489): Terminated: ok {rc=0} 12:54:03.365767 bus /gobi_0: Setting Powered False 12:54:04.461882 bus /gobi_0: Setting Powered False 12:54:05.577504 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:54:06.725604 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:06.737416 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:54:06.799832 tst iperf3.py: using LAC 21595 12:54:06.922780 tst iperf3.py: using RAC 175 12:54:07.049661 tst iperf3.py: using CellId 21595 12:54:07.172015 tst iperf3.py: using BVCI 21596 12:54:07.284648 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:07.295848 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:07.306716 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:07.317666 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:07.328363 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:07.339243 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:07.350272 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:07.360869 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:07.371867 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:54:07.492043 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:54:07.701318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:54:08.015350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7491): Launched 12:54:08.289041 run iperf3-srv_10.42.42.10(pid=7492): Launched 12:54:08.405655 tst iperf3.py:8: start network... 12:54:08.613546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:54:09.095535 run create_hlr_db(pid=7493): Launched 12:54:09.218237 bus /gobi_6: Setting Powered False 12:54:10.280664 run create_hlr_db(pid=7493): Terminated: ok {rc=0} 12:54:10.714011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7495): Launched 12:54:11.027365 run osmo-hlr_10.42.42.2(pid=7496): Launched 12:54:11.147677 run osmo-stp_10.42.42.5: Starting osmo-stp 12:54:11.702541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7498): Launched 12:54:12.015799 run osmo-stp_10.42.42.5(pid=7499): Launched 12:54:12.134947 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:54:12.669627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7501): Launched 12:54:12.787890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:54:13.052240 run patchelf(pid=7502): Launched 12:54:13.224325 run osmo-stp_10.42.42.5(pid=7499): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7499)] 12:54:13.355489 run osmo-stp_10.42.42.5(pid=7499): stdout: | (launched: 2022-12-09_12:54:11.957394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:13.488036 run osmo-stp_10.42.42.5(pid=7499): stderr: | 20221209125412132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125412132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125412133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125412133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125412133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125412133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125412134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:13.620490 run osmo-stp_10.42.42.5(pid=7499): stdout: | (launched: 2022-12-09_12:54:11.957394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:13.747984 run osmo-stp_10.42.42.5(pid=7499): stderr: | 20221209125412132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125412132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125412133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125412133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125412133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125412133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125412134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:13.899108 run patchelf(pid=7502): Terminating (SIGINT) 12:54:14.071908 run patchelf(pid=7502): Terminated: ok {rc=0} 12:54:14.196210 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7499): Process ended prematurely: osmo-stp_10.42.42.5(pid=7499) [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7499)] [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 12:54:14.205876 tst iperf3.py:8: Test FAILED (7.5 sec) 12:54:14.233434 run osmo-hlr_10.42.42.2(pid=7496): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7496)] 12:54:14.281674 run osmo-hlr_10.42.42.2(pid=7496): stdout: | (launched: 2022-12-09_12:54:10.968816) 12:54:14.331731 run osmo-hlr_10.42.42.2(pid=7496): stderr: | 20221209125411151 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125411151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125411152 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125411152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125411152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125411152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125411164 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125411172 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125411173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125411173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:54:14.382280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7491): Terminating (SIGTERM) 12:54:14.422686 run iperf3-srv_10.42.42.10(pid=7492): Terminating (SIGTERM) 12:54:14.463078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7495): Terminating (SIGTERM) 12:54:14.503574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7498): Terminating (SIGTERM) 12:54:14.544067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7501): Terminating (SIGTERM) 12:54:14.584866 --- ParallelTerminationStrategy: PID 7491 died... 12:54:14.604265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7491): Terminated: ok {rc=0} 12:54:14.649407 --- ParallelTerminationStrategy: PID 7492 died... 12:54:14.668317 run iperf3-srv_10.42.42.10(pid=7492): Terminated {rc=256} 12:54:14.712757 --- ParallelTerminationStrategy: PID 7495 died... 12:54:14.731757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7495): Terminated: ok {rc=0} 12:54:14.776615 --- ParallelTerminationStrategy: PID 7498 died... 12:54:14.795623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7498): Terminated: ok {rc=0} 12:54:14.840113 --- ParallelTerminationStrategy: PID 7501 died... 12:54:14.859250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7501): Terminated: ok {rc=0} 12:54:14.944173 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:54:16.101216 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:16.113483 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:54:16.174124 tst iperf3m4.py: using LAC 21596 12:54:16.310452 tst iperf3m4.py: using RAC 176 12:54:16.463223 tst iperf3m4.py: using CellId 21596 12:54:16.596630 tst iperf3m4.py: using BVCI 21597 12:54:16.717561 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:16.729457 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:16.742481 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:16.753881 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:16.765735 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:16.778247 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:16.789991 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:16.801916 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:16.814117 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:54:16.931355 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:54:17.051279 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:54:17.170922 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:54:17.290954 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:54:17.500741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:54:17.815587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7503): Launched 12:54:18.088765 run iperf3-srv_10.42.42.10(pid=7504): Launched 12:54:18.205597 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:54:18.412384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:54:18.724265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7505): Launched 12:54:18.997625 run iperf3-srv_10.42.42.10(pid=7506): Launched 12:54:19.114382 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:54:19.336860 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:54:19.673200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7507): Launched 12:54:19.966224 run iperf3-srv_10.42.42.10(pid=7508): Launched 12:54:20.091444 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:54:20.316238 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:54:20.652279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7509): Launched 12:54:20.945562 run iperf3-srv_10.42.42.10(pid=7510): Launched 12:54:21.072154 tst iperf3m4.py:8: start network... 12:54:21.297295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:54:21.815873 run create_hlr_db(pid=7511): Launched 12:54:21.944402 bus /gobi_6: Setting Powered False 12:54:23.010397 run create_hlr_db(pid=7511): Terminated: ok {rc=0} 12:54:23.475064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7513): Launched 12:54:23.811284 run osmo-hlr_10.42.42.2(pid=7514): Launched 12:54:23.938852 run osmo-stp_10.42.42.5: Starting osmo-stp 12:54:24.514161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7516): Launched 12:54:24.847343 run osmo-stp_10.42.42.5(pid=7517): Launched 12:54:24.974232 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:54:25.549684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7519): Launched 12:54:25.676182 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:54:25.959162 run patchelf(pid=7521): Launched 12:54:26.143485 run osmo-stp_10.42.42.5(pid=7517): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7517)] 12:54:26.284583 run osmo-stp_10.42.42.5(pid=7517): stdout: | (launched: 2022-12-09_12:54:24.784570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:26.426352 run osmo-stp_10.42.42.5(pid=7517): stderr: | 20221209125424981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125424982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125424982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125424982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125424984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125424985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125424985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:26.568176 run osmo-stp_10.42.42.5(pid=7517): stdout: | (launched: 2022-12-09_12:54:24.784570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:26.704003 run osmo-stp_10.42.42.5(pid=7517): stderr: | 20221209125424981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125424982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125424982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125424982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125424984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125424985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125424985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:26.865366 run patchelf(pid=7521): Terminating (SIGINT) 12:54:27.050365 run patchelf(pid=7521): Terminated: ok {rc=0} 12:54:27.183801 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7517): Process ended prematurely: osmo-stp_10.42.42.5(pid=7517) [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7517)] [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:54:27.194093 tst iperf3m4.py:8: Test FAILED (11.1 sec) 12:54:27.224287 run osmo-hlr_10.42.42.2(pid=7514): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7514)] 12:54:27.275690 run osmo-hlr_10.42.42.2(pid=7514): stdout: | (launched: 2022-12-09_12:54:23.748482) 12:54:27.328745 run osmo-hlr_10.42.42.2(pid=7514): stderr: | 20221209125423951 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125423951 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125423951 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125423951 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125423951 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125423951 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125423963 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125423972 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125423972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125423972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:54:27.382016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7503): Terminating (SIGTERM) 12:54:27.424660 run iperf3-srv_10.42.42.10(pid=7504): Terminating (SIGTERM) 12:54:27.467208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7505): Terminating (SIGTERM) 12:54:27.509828 run iperf3-srv_10.42.42.10(pid=7506): Terminating (SIGTERM) 12:54:27.552353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7507): Terminating (SIGTERM) 12:54:27.595040 run iperf3-srv_10.42.42.10(pid=7508): Terminating (SIGTERM) 12:54:27.637571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7509): Terminating (SIGTERM) 12:54:27.680228 run iperf3-srv_10.42.42.10(pid=7510): Terminating (SIGTERM) 12:54:27.723247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7513): Terminating (SIGTERM) 12:54:27.766052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7516): Terminating (SIGTERM) 12:54:27.808629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7519): Terminating (SIGTERM) 12:54:27.851713 --- ParallelTerminationStrategy: PID 7503 died... 12:54:27.872219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7503): Terminated: ok {rc=0} 12:54:27.919807 --- ParallelTerminationStrategy: PID 7504 died... 12:54:27.939687 run iperf3-srv_10.42.42.10(pid=7504): Terminated {rc=256} 12:54:27.986563 --- ParallelTerminationStrategy: PID 7505 died... 12:54:28.006437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7505): Terminated: ok {rc=0} 12:54:28.054113 --- ParallelTerminationStrategy: PID 7506 died... 12:54:28.073946 run iperf3-srv_10.42.42.10(pid=7506): Terminated {rc=256} 12:54:28.120915 --- ParallelTerminationStrategy: PID 7507 died... 12:54:28.140989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7507): Terminated: ok {rc=0} 12:54:28.188055 --- ParallelTerminationStrategy: PID 7508 died... 12:54:28.207918 run iperf3-srv_10.42.42.10(pid=7508): Terminated {rc=256} 12:54:28.255218 --- ParallelTerminationStrategy: PID 7509 died... 12:54:28.275374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7509): Terminated: ok {rc=0} 12:54:28.322558 --- ParallelTerminationStrategy: PID 7510 died... 12:54:28.342634 run iperf3-srv_10.42.42.10(pid=7510): Terminated {rc=256} 12:54:28.389626 --- ParallelTerminationStrategy: PID 7513 died... 12:54:28.409690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7513): Terminated: ok {rc=0} 12:54:28.457123 --- ParallelTerminationStrategy: PID 7516 died... 12:54:28.476891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7516): Terminated: ok {rc=0} 12:54:28.524254 --- ParallelTerminationStrategy: PID 7519 died... 12:54:28.544259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7519): Terminated: ok {rc=0} 12:54:28.634269 bus /gobi_4: Setting Powered False 12:54:29.735004 bus /gobi_4: Setting Powered False 12:54:30.852807 bus /gobi_1: Setting Powered False 12:54:31.960089 bus /gobi_1: Setting Powered False 12:54:33.089518 bus /gobi_0: Setting Powered False 12:54:34.188359 bus /gobi_0: Setting Powered False 12:54:35.307891 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:54:36.412229 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:36.424485 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:54:36.484796 tst ping.py: using LAC 21597 12:54:36.605301 tst ping.py: using RAC 177 12:54:36.725350 tst ping.py: using CellId 21597 12:54:36.845585 tst ping.py: using BVCI 21598 12:54:36.958704 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:36.969924 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:36.980897 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:36.991651 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:37.002444 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:37.013113 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:37.024037 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:37.034783 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:54:37.152324 tst ping.py:19: start network... 12:54:37.372816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:54:37.881472 run create_hlr_db(pid=7522): Launched 12:54:38.007898 bus /gobi_6: Setting Powered False 12:54:39.068167 run create_hlr_db(pid=7522): Terminated: ok {rc=0} 12:54:39.528903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7524): Launched 12:54:39.858691 run osmo-hlr_10.42.42.2(pid=7525): Launched 12:54:39.983984 run osmo-stp_10.42.42.5: Starting osmo-stp 12:54:40.561003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7527): Launched 12:54:40.888928 run osmo-stp_10.42.42.5(pid=7528): Launched 12:54:41.013740 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:54:41.577731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7530): Launched 12:54:41.702943 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:54:41.979903 run patchelf(pid=7531): Launched 12:54:42.163423 run osmo-stp_10.42.42.5(pid=7528): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7528)] 12:54:42.302484 run osmo-stp_10.42.42.5(pid=7528): stdout: | (launched: 2022-12-09_12:54:40.827425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:42.441699 run osmo-stp_10.42.42.5(pid=7528): stderr: | 20221209125441023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125441023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125441023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125441023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125441024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125441024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125441024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:42.581313 run osmo-stp_10.42.42.5(pid=7528): stdout: | (launched: 2022-12-09_12:54:40.827425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:42.714794 run osmo-stp_10.42.42.5(pid=7528): stderr: | 20221209125441023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125441023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125441023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125441023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125441024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125441024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125441024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:42.872706 run patchelf(pid=7531): Terminating (SIGINT) 12:54:43.054448 run patchelf(pid=7531): Terminated: ok {rc=0} 12:54:43.185413 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7528): Process ended prematurely: osmo-stp_10.42.42.5(pid=7528) [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7528)] [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 12:54:43.195019 tst ping.py:22: Test FAILED (6.8 sec) 12:54:43.224152 run osmo-hlr_10.42.42.2(pid=7525): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7525)] 12:54:43.274887 run osmo-hlr_10.42.42.2(pid=7525): stdout: | (launched: 2022-12-09_12:54:39.796554) 12:54:43.327170 run osmo-hlr_10.42.42.2(pid=7525): stderr: | 20221209125440001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125440001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125440001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125440001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125440001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125440001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125440012 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125440021 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125440021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125440021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:54:43.379895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7524): Terminating (SIGTERM) 12:54:43.422169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7527): Terminating (SIGTERM) 12:54:43.464397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7530): Terminating (SIGTERM) 12:54:43.507112 --- ParallelTerminationStrategy: PID 7524 died... 12:54:43.527346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7524): Terminated: ok {rc=0} 12:54:43.574111 --- ParallelTerminationStrategy: PID 7527 died... 12:54:43.593716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7527): Terminated: ok {rc=0} 12:54:43.640260 --- ParallelTerminationStrategy: PID 7530 died... 12:54:43.659908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7530): Terminated: ok {rc=0} 12:54:43.748300 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:54:44.835168 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:44.847031 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:54:44.905025 tst ping_idle_ping.py: using LAC 21598 12:54:45.026320 tst ping_idle_ping.py: using RAC 178 12:54:45.144578 tst ping_idle_ping.py: using CellId 21598 12:54:45.263508 tst ping_idle_ping.py: using BVCI 21599 12:54:45.373742 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:45.384547 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:45.395285 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:45.405990 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:45.416480 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:45.427028 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:45.437845 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:54:45.448464 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:54:45.567217 tst ping_idle_ping.py:24: start network... 12:54:45.787162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:54:46.326822 run create_hlr_db(pid=7532): Launched 12:54:46.491480 bus /gobi_6: Setting Powered False 12:54:47.552703 run create_hlr_db(pid=7532): Terminated: ok {rc=0} 12:54:48.018135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7534): Launched 12:54:48.337248 run osmo-hlr_10.42.42.2(pid=7535): Launched 12:54:48.457876 run osmo-stp_10.42.42.5: Starting osmo-stp 12:54:49.006028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7537): Launched 12:54:49.323256 run osmo-stp_10.42.42.5(pid=7538): Launched 12:54:49.445766 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:54:49.991125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7540): Launched 12:54:50.112768 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:54:50.381624 run patchelf(pid=7541): Launched 12:54:50.557356 run osmo-stp_10.42.42.5(pid=7538): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7538)] 12:54:50.691965 run osmo-stp_10.42.42.5(pid=7538): stdout: | (launched: 2022-12-09_12:54:49.264132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:50.827833 run osmo-stp_10.42.42.5(pid=7538): stderr: | 20221209125449454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125449454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125449454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125449455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125449455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125449455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125449455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:50.963855 run osmo-stp_10.42.42.5(pid=7538): stdout: | (launched: 2022-12-09_12:54:49.264132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:54:51.094298 run osmo-stp_10.42.42.5(pid=7538): stderr: | 20221209125449454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125449454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125449454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125449455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125449455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125449455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125449455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:54:51.248940 run patchelf(pid=7541): Terminating (SIGINT) 12:54:51.426432 run patchelf(pid=7541): Terminated: ok {rc=0} 12:54:51.554120 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7538): Process ended prematurely: osmo-stp_10.42.42.5(pid=7538) [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7538)] [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:54:51.563518 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:54:51.592839 run osmo-hlr_10.42.42.2(pid=7535): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7535)] 12:54:51.643582 run osmo-hlr_10.42.42.2(pid=7535): stdout: | (launched: 2022-12-09_12:54:48.277870) 12:54:51.695994 run osmo-hlr_10.42.42.2(pid=7535): stderr: | 20221209125448478 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125448478 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125448478 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125448478 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125448478 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125448478 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125448491 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125448500 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125448500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125448500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:54:51.748941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7534): Terminating (SIGTERM) 12:54:51.791718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7537): Terminating (SIGTERM) 12:54:51.834200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7540): Terminating (SIGTERM) 12:54:51.876661 --- ParallelTerminationStrategy: PID 7534 died... 12:54:51.896611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7534): Terminated: ok {rc=0} 12:54:51.943887 --- ParallelTerminationStrategy: PID 7537 died... 12:54:51.963324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7537): Terminated: ok {rc=0} 12:54:52.010672 --- ParallelTerminationStrategy: PID 7540 died... 12:54:52.030130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7540): Terminated: ok {rc=0} 12:54:52.120024 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:54:53.410794 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:54:53.417583 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:54:53.440587 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 12:54:53.481514 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 12:54:53.571060 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:54:53.591993 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 12:54:53.630737 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 12:54:54.228861 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 12:54:54.282426 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:54:54.293667 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:54:54.350532 tst cs_paging_gprs_active.py: using LAC 21599 12:54:54.476145 tst cs_paging_gprs_active.py: using RAC 179 12:54:54.601378 tst cs_paging_gprs_active.py: using CellId 21599 12:54:54.725759 tst cs_paging_gprs_active.py: using BVCI 21600 12:54:54.844383 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:54:54.855658 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:54:54.866681 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:54:54.878390 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:54:54.890003 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:54:54.901628 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:54:54.913430 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:54:54.924859 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:54:54.936775 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:54:55.051399 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:54:55.171578 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:54:55.388445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:54:55.711200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7546): Launched 12:54:55.991081 run iperf3-srv_10.42.42.10(pid=7547): Launched 12:54:56.111609 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:54:56.328241 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:54:56.651213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7548): Launched 12:54:56.931469 run iperf3-srv_10.42.42.10(pid=7549): Launched 12:54:57.051786 tst cs_paging_gprs_active.py:38: start network... 12:54:57.268297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:54:57.767821 run create_hlr_db(pid=7550): Launched 12:54:57.889646 bus /gobi_6: Setting Powered False 12:54:58.952938 run create_hlr_db(pid=7550): Terminated: ok {rc=0} 12:54:59.399210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7552): Launched 12:54:59.721132 run osmo-hlr_10.42.42.2(pid=7553): Launched 12:54:59.844141 run osmo-stp_10.42.42.5: Starting osmo-stp 12:55:00.401860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7555): Launched 12:55:00.723397 run osmo-stp_10.42.42.5(pid=7556): Launched 12:55:00.847344 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:55:01.565676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7558): Launched 12:55:01.697352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:55:01.987765 run patchelf(pid=7562): Launched 12:55:02.170562 run osmo-stp_10.42.42.5(pid=7556): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7556)] 12:55:02.299869 run osmo-stp_10.42.42.5(pid=7556): stdout: | (launched: 2022-12-09_12:55:00.663621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:02.428593 run osmo-stp_10.42.42.5(pid=7556): stderr: | 20221209125500895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125500895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125500895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125500896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125500896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125500896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125500896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:02.557756 run osmo-stp_10.42.42.5(pid=7556): stdout: | (launched: 2022-12-09_12:55:00.663621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:02.680902 run osmo-stp_10.42.42.5(pid=7556): stderr: | 20221209125500895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125500895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125500895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125500896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125500896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125500896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125500896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:02.827227 run patchelf(pid=7562): Terminating (SIGINT) 12:55:02.994801 run patchelf(pid=7562): Terminated: ok {rc=0} 12:55:03.115961 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7556): Process ended prematurely: osmo-stp_10.42.42.5(pid=7556) [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7556)] [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 12:55:03.125713 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 12:55:03.152567 run osmo-hlr_10.42.42.2(pid=7553): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7553)] 12:55:03.199923 run osmo-hlr_10.42.42.2(pid=7553): stdout: | (launched: 2022-12-09_12:54:59.661065) 12:55:03.248563 run osmo-hlr_10.42.42.2(pid=7553): stderr: | 20221209125459858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125459859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125459859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125459859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125459859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125459859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125459871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125459879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125459880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125459880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:55:03.298069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7546): Terminating (SIGTERM) 12:55:03.337779 run iperf3-srv_10.42.42.10(pid=7547): Terminating (SIGTERM) 12:55:03.377173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7548): Terminating (SIGTERM) 12:55:03.416820 run iperf3-srv_10.42.42.10(pid=7549): Terminating (SIGTERM) 12:55:03.456074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7552): Terminating (SIGTERM) 12:55:03.495517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7555): Terminating (SIGTERM) 12:55:03.534786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7558): Terminating (SIGTERM) 12:55:03.574357 --- ParallelTerminationStrategy: PID 7546 died... 12:55:03.593498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7546): Terminated: ok {rc=0} 12:55:03.637496 --- ParallelTerminationStrategy: PID 7547 died... 12:55:03.656205 run iperf3-srv_10.42.42.10(pid=7547): Terminated {rc=256} 12:55:03.700229 --- ParallelTerminationStrategy: PID 7548 died... 12:55:03.718834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7548): Terminated: ok {rc=0} 12:55:03.762419 --- ParallelTerminationStrategy: PID 7549 died... 12:55:03.780872 run iperf3-srv_10.42.42.10(pid=7549): Terminated {rc=256} 12:55:03.824561 --- ParallelTerminationStrategy: PID 7552 died... 12:55:03.843171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7552): Terminated: ok {rc=0} 12:55:03.887206 --- ParallelTerminationStrategy: PID 7555 died... 12:55:03.905929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7555): Terminated: ok {rc=0} 12:55:03.949763 --- ParallelTerminationStrategy: PID 7558 died... 12:55:03.968180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7558): Terminated: ok {rc=0} 12:55:04.052864 bus /gobi_0: Setting Powered False 12:55:05.152369 bus /gobi_0: Setting Powered False 12:55:06.267540 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 12:55:07.411638 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:07.423214 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:55:07.482675 tst iperf3.py: using LAC 21600 12:55:07.603503 tst iperf3.py: using RAC 180 12:55:07.723583 tst iperf3.py: using CellId 21600 12:55:07.841044 tst iperf3.py: using BVCI 21601 12:55:07.950278 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:07.961317 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:07.972020 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:07.982764 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:07.993385 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:08.004035 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:08.014810 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:08.025633 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:08.036320 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:55:08.153183 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:55:08.370145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:55:08.694605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7563): Launched 12:55:08.975598 run iperf3-srv_10.42.42.10(pid=7564): Launched 12:55:09.096218 tst iperf3.py:8: start network... 12:55:09.313192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:55:09.812017 run create_hlr_db(pid=7565): Launched 12:55:09.934405 bus /gobi_6: Setting Powered False 12:55:10.998360 run create_hlr_db(pid=7565): Terminated: ok {rc=0} 12:55:11.427897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7567): Launched 12:55:11.727731 run osmo-hlr_10.42.42.2(pid=7568): Launched 12:55:11.841501 run osmo-stp_10.42.42.5: Starting osmo-stp 12:55:12.359833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7570): Launched 12:55:12.660460 run osmo-stp_10.42.42.5(pid=7571): Launched 12:55:12.774983 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:55:13.293154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7573): Launched 12:55:13.416548 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:55:13.690048 run patchelf(pid=7574): Launched 12:55:13.867959 run osmo-stp_10.42.42.5(pid=7571): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7571)] 12:55:14.003632 run osmo-stp_10.42.42.5(pid=7571): stdout: | (launched: 2022-12-09_12:55:12.603804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:14.140763 run osmo-stp_10.42.42.5(pid=7571): stderr: | 20221209125512777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125512777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125512778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125512778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125512778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125512779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125512779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:14.279270 run osmo-stp_10.42.42.5(pid=7571): stdout: | (launched: 2022-12-09_12:55:12.603804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:14.411318 run osmo-stp_10.42.42.5(pid=7571): stderr: | 20221209125512777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125512777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125512778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125512778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125512778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125512779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125512779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:14.567636 run patchelf(pid=7574): Terminating (SIGINT) 12:55:14.746536 run patchelf(pid=7574): Terminated: ok {rc=0} 12:55:14.875780 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7571): Process ended prematurely: osmo-stp_10.42.42.5(pid=7571) [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7571)] [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 12:55:14.885817 tst iperf3.py:8: Test FAILED (7.5 sec) 12:55:14.914527 run osmo-hlr_10.42.42.2(pid=7568): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7568)] 12:55:14.964306 run osmo-hlr_10.42.42.2(pid=7568): stdout: | (launched: 2022-12-09_12:55:11.671349) 12:55:15.015822 run osmo-hlr_10.42.42.2(pid=7568): stderr: | 20221209125511846 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125511846 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125511846 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125511846 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125511846 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125511847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125511859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125511868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125511868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125511868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:55:15.067835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7563): Terminating (SIGTERM) 12:55:15.109871 run iperf3-srv_10.42.42.10(pid=7564): Terminating (SIGTERM) 12:55:15.151367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7567): Terminating (SIGTERM) 12:55:15.192943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7570): Terminating (SIGTERM) 12:55:15.234707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7573): Terminating (SIGTERM) 12:55:15.276444 --- ParallelTerminationStrategy: PID 7563 died... 12:55:15.296370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7563): Terminated: ok {rc=0} 12:55:15.343055 --- ParallelTerminationStrategy: PID 7564 died... 12:55:15.362654 run iperf3-srv_10.42.42.10(pid=7564): Terminated {rc=256} 12:55:15.408518 --- ParallelTerminationStrategy: PID 7567 died... 12:55:15.427829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7567): Terminated: ok {rc=0} 12:55:15.473809 --- ParallelTerminationStrategy: PID 7570 died... 12:55:15.493304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7570): Terminated: ok {rc=0} 12:55:15.539466 --- ParallelTerminationStrategy: PID 7573 died... 12:55:15.558935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7573): Terminated: ok {rc=0} 12:55:15.646603 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 12:55:16.819877 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:16.835898 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:55:16.905915 tst iperf3m4.py: using LAC 21601 12:55:17.072786 tst iperf3m4.py: using RAC 181 12:55:17.228778 tst iperf3m4.py: using CellId 21601 12:55:17.349130 tst iperf3m4.py: using BVCI 21602 12:55:17.458559 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:17.469690 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:17.480362 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:17.492590 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:17.504182 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:17.515376 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:17.526636 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:17.537762 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:17.548911 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:55:17.667938 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:55:17.786664 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:55:17.902658 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:55:18.020103 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:55:18.229829 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:55:18.542212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7575): Launched 12:55:18.801087 run iperf3-srv_10.42.42.10(pid=7576): Launched 12:55:18.912761 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:55:19.110754 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:55:19.409272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7577): Launched 12:55:19.668789 run iperf3-srv_10.42.42.10(pid=7578): Launched 12:55:19.779958 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:55:19.977589 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:55:20.275730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7579): Launched 12:55:20.535788 run iperf3-srv_10.42.42.10(pid=7580): Launched 12:55:20.647354 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:55:20.845212 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:55:21.143451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7581): Launched 12:55:21.402696 run iperf3-srv_10.42.42.10(pid=7582): Launched 12:55:21.513942 tst iperf3m4.py:8: start network... 12:55:21.712012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:55:22.172347 run create_hlr_db(pid=7583): Launched 12:55:22.295520 bus /gobi_6: Setting Powered False 12:55:23.356046 run create_hlr_db(pid=7583): Terminated: ok {rc=0} 12:55:23.791222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7585): Launched 12:55:24.111081 run osmo-hlr_10.42.42.2(pid=7586): Launched 12:55:24.233342 run osmo-stp_10.42.42.5: Starting osmo-stp 12:55:24.788084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7588): Launched 12:55:25.106835 run osmo-stp_10.42.42.5(pid=7589): Launched 12:55:25.228108 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:55:25.779280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7591): Launched 12:55:25.902030 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:55:26.172726 run patchelf(pid=7592): Launched 12:55:26.354828 run osmo-stp_10.42.42.5(pid=7589): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7589)] 12:55:26.492747 run osmo-stp_10.42.42.5(pid=7589): stdout: | (launched: 2022-12-09_12:55:25.048185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:26.632004 run osmo-stp_10.42.42.5(pid=7589): stderr: | 20221209125525235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125525235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125525235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125525236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125525236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125525236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125525236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:26.771705 run osmo-stp_10.42.42.5(pid=7589): stdout: | (launched: 2022-12-09_12:55:25.048185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:26.905414 run osmo-stp_10.42.42.5(pid=7589): stderr: | 20221209125525235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125525235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125525235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125525236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125525236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125525236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125525236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:27.064363 run patchelf(pid=7592): Terminating (SIGINT) 12:55:27.246281 run patchelf(pid=7592): Terminated: ok {rc=0} 12:55:27.377920 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7589): Process ended prematurely: osmo-stp_10.42.42.5(pid=7589) [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7589)] [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 12:55:27.388168 tst iperf3m4.py:8: Test FAILED (10.6 sec) 12:55:27.417758 run osmo-hlr_10.42.42.2(pid=7586): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7586)] 12:55:27.468394 run osmo-hlr_10.42.42.2(pid=7586): stdout: | (launched: 2022-12-09_12:55:24.052091) 12:55:27.520796 run osmo-hlr_10.42.42.2(pid=7586): stderr: | 20221209125524246 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125524246 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125524246 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125524246 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125524246 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125524246 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125524259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125524269 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125524270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125524270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:55:27.573652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7575): Terminating (SIGTERM) 12:55:27.616125 run iperf3-srv_10.42.42.10(pid=7576): Terminating (SIGTERM) 12:55:27.658574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7577): Terminating (SIGTERM) 12:55:27.701092 run iperf3-srv_10.42.42.10(pid=7578): Terminating (SIGTERM) 12:55:27.743501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7579): Terminating (SIGTERM) 12:55:27.785836 run iperf3-srv_10.42.42.10(pid=7580): Terminating (SIGTERM) 12:55:27.827965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7581): Terminating (SIGTERM) 12:55:27.870361 run iperf3-srv_10.42.42.10(pid=7582): Terminating (SIGTERM) 12:55:27.912543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7585): Terminating (SIGTERM) 12:55:27.954963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7588): Terminating (SIGTERM) 12:55:27.997276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7591): Terminating (SIGTERM) 12:55:28.039689 --- ParallelTerminationStrategy: PID 7575 died... 12:55:28.059694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7575): Terminated: ok {rc=0} 12:55:28.107028 --- ParallelTerminationStrategy: PID 7576 died... 12:55:28.126864 run iperf3-srv_10.42.42.10(pid=7576): Terminated {rc=256} 12:55:28.174006 --- ParallelTerminationStrategy: PID 7577 died... 12:55:28.193875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7577): Terminated: ok {rc=0} 12:55:28.241427 --- ParallelTerminationStrategy: PID 7578 died... 12:55:28.260900 run iperf3-srv_10.42.42.10(pid=7578): Terminated {rc=256} 12:55:28.308630 --- ParallelTerminationStrategy: PID 7579 died... 12:55:28.328604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7579): Terminated: ok {rc=0} 12:55:28.376190 --- ParallelTerminationStrategy: PID 7580 died... 12:55:28.396148 run iperf3-srv_10.42.42.10(pid=7580): Terminated {rc=256} 12:55:28.443210 --- ParallelTerminationStrategy: PID 7581 died... 12:55:28.463176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7581): Terminated: ok {rc=0} 12:55:28.510255 --- ParallelTerminationStrategy: PID 7582 died... 12:55:28.530191 run iperf3-srv_10.42.42.10(pid=7582): Terminated {rc=256} 12:55:28.594357 --- ParallelTerminationStrategy: PID 7585 died... 12:55:28.614745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7585): Terminated: ok {rc=0} 12:55:28.662478 --- ParallelTerminationStrategy: PID 7588 died... 12:55:28.682586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7588): Terminated: ok {rc=0} 12:55:28.730827 --- ParallelTerminationStrategy: PID 7591 died... 12:55:28.750745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7591): Terminated: ok {rc=0} 12:55:28.840433 bus /gobi_4: Setting Powered False 12:55:29.937392 bus /gobi_4: Setting Powered False 12:55:31.059430 bus /gobi_1: Setting Powered False 12:55:32.159036 bus /gobi_1: Setting Powered False 12:55:33.281318 bus /gobi_0: Setting Powered False 12:55:34.380685 bus /gobi_0: Setting Powered False 12:55:35.497581 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 12:55:36.600660 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:36.612660 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:55:36.672889 tst ping.py: using LAC 21602 12:55:36.797463 tst ping.py: using RAC 182 12:55:36.917339 tst ping.py: using CellId 21602 12:55:37.033361 tst ping.py: using BVCI 21603 12:55:37.139777 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:37.150786 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:37.161466 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:37.172082 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:37.182650 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:37.193489 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:37.204239 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:37.214824 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:55:37.330041 tst ping.py:19: start network... 12:55:37.525699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:55:37.978711 run create_hlr_db(pid=7593): Launched 12:55:38.100324 bus /gobi_6: Setting Powered False 12:55:39.159868 run create_hlr_db(pid=7593): Terminated: ok {rc=0} 12:55:39.594972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7595): Launched 12:55:39.912895 run osmo-hlr_10.42.42.2(pid=7596): Launched 12:55:40.036582 run osmo-stp_10.42.42.5: Starting osmo-stp 12:55:40.589617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7598): Launched 12:55:40.905679 run osmo-stp_10.42.42.5(pid=7599): Launched 12:55:41.025748 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:55:41.571410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7601): Launched 12:55:41.693715 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:55:41.961839 run patchelf(pid=7602): Launched 12:55:42.132024 run osmo-stp_10.42.42.5(pid=7599): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7599)] 12:55:42.267455 run osmo-stp_10.42.42.5(pid=7599): stdout: | (launched: 2022-12-09_12:55:40.848259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:42.403848 run osmo-stp_10.42.42.5(pid=7599): stderr: | 20221209125541034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125541035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125541035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125541035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125541036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125541036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125541036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:42.540656 run osmo-stp_10.42.42.5(pid=7599): stdout: | (launched: 2022-12-09_12:55:40.848259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:42.671098 run osmo-stp_10.42.42.5(pid=7599): stderr: | 20221209125541034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125541035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125541035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125541035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125541036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125541036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125541036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:42.825442 run patchelf(pid=7602): Terminating (SIGINT) 12:55:43.002704 run patchelf(pid=7602): Terminated: ok {rc=0} 12:55:43.130700 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7599): Process ended prematurely: osmo-stp_10.42.42.5(pid=7599) [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7599)] [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 12:55:43.140145 tst ping.py:22: Test FAILED (6.5 sec) 12:55:43.168939 run osmo-hlr_10.42.42.2(pid=7596): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7596)] 12:55:43.219556 run osmo-hlr_10.42.42.2(pid=7596): stdout: | (launched: 2022-12-09_12:55:39.854985) 12:55:43.272142 run osmo-hlr_10.42.42.2(pid=7596): stderr: | 20221209125540046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125540046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125540046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125540047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125540047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125540047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125540059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125540068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125540069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125540069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:55:43.325086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7595): Terminating (SIGTERM) 12:55:43.367414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7598): Terminating (SIGTERM) 12:55:43.409716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7601): Terminating (SIGTERM) 12:55:43.452046 --- ParallelTerminationStrategy: PID 7595 died... 12:55:43.472158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7595): Terminated: ok {rc=0} 12:55:43.519098 --- ParallelTerminationStrategy: PID 7598 died... 12:55:43.538897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7598): Terminated: ok {rc=0} 12:55:43.585526 --- ParallelTerminationStrategy: PID 7601 died... 12:55:43.605220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7601): Terminated: ok {rc=0} 12:55:43.692663 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 12:55:44.780006 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:44.791933 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:55:44.851741 tst ping_idle_ping.py: using LAC 21603 12:55:44.969794 tst ping_idle_ping.py: using RAC 183 12:55:45.088706 tst ping_idle_ping.py: using CellId 21603 12:55:45.205860 tst ping_idle_ping.py: using BVCI 21604 12:55:45.314298 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:45.325347 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:45.336043 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:45.346744 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:45.357416 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:45.368118 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:45.378940 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:55:45.389612 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:55:45.504253 tst ping_idle_ping.py:24: start network... 12:55:45.704257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:55:46.196770 run create_hlr_db(pid=7603): Launched 12:55:46.375125 bus /gobi_6: Setting Powered False 12:55:47.434994 run create_hlr_db(pid=7603): Terminated: ok {rc=0} 12:55:47.895111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7605): Launched 12:55:48.213543 run osmo-hlr_10.42.42.2(pid=7606): Launched 12:55:48.335380 run osmo-stp_10.42.42.5: Starting osmo-stp 12:55:48.882677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7608): Launched 12:55:49.201818 run osmo-stp_10.42.42.5(pid=7609): Launched 12:55:49.323766 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:55:49.874111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7611): Launched 12:55:49.996312 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:55:50.266336 run patchelf(pid=7612): Launched 12:55:50.444406 run osmo-stp_10.42.42.5(pid=7609): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7609)] 12:55:50.580341 run osmo-stp_10.42.42.5(pid=7609): stdout: | (launched: 2022-12-09_12:55:49.142936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:50.717782 run osmo-stp_10.42.42.5(pid=7609): stderr: | 20221209125549331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125549331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125549331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125549332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125549332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125549332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125549332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:50.855317 run osmo-stp_10.42.42.5(pid=7609): stdout: | (launched: 2022-12-09_12:55:49.142936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:50.986595 run osmo-stp_10.42.42.5(pid=7609): stderr: | 20221209125549331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125549331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125549331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125549332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125549332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125549332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125549332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:51.142335 run patchelf(pid=7612): Terminating (SIGINT) 12:55:51.321644 run patchelf(pid=7612): Terminated: ok {rc=0} 12:55:51.450542 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7609): Process ended prematurely: osmo-stp_10.42.42.5(pid=7609) [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7609)] [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 12:55:51.460234 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:55:51.488584 run osmo-hlr_10.42.42.2(pid=7606): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7606)] 12:55:51.539331 run osmo-hlr_10.42.42.2(pid=7606): stdout: | (launched: 2022-12-09_12:55:48.155294) 12:55:51.591682 run osmo-hlr_10.42.42.2(pid=7606): stderr: | 20221209125548348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125548348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125548348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125548348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125548348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125548348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125548361 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125548370 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125548370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125548370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:55:51.644417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7605): Terminating (SIGTERM) 12:55:51.686518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7608): Terminating (SIGTERM) 12:55:51.728735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7611): Terminating (SIGTERM) 12:55:51.771475 --- ParallelTerminationStrategy: PID 7605 died... 12:55:51.791762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7605): Terminated: ok {rc=0} 12:55:51.838859 --- ParallelTerminationStrategy: PID 7608 died... 12:55:51.858825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7608): Terminated: ok {rc=0} 12:55:51.905615 --- ParallelTerminationStrategy: PID 7611 died... 12:55:51.925405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7611): Terminated: ok {rc=0} 12:55:52.014105 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:55:53.312735 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:55:53.320473 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:55:53.342831 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:55:53.378256 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:55:53.430367 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:55:53.451516 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:55:53.487178 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:55:54.047579 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2360 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:55:54.052780 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:55:54.064367 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:55:54.120527 tst switch_tch_pdch.py: using LAC 21604 12:55:54.245254 tst switch_tch_pdch.py: using RAC 184 12:55:54.368560 tst switch_tch_pdch.py: using CellId 21604 12:55:54.490806 tst switch_tch_pdch.py: using BVCI 21605 12:55:54.606518 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:55:54.618177 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:55:54.629584 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:55:54.641211 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:55:54.652646 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:55:54.664309 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:55:54.676059 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:55:54.687658 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:55:54.804156 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:55:54.920925 tst switch_tch_pdch.py:51: start network... 12:55:55.120577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:55:55.580782 run create_hlr_db(pid=7617): Launched 12:55:55.702346 bus /gobi_6: Setting Powered False 12:55:56.761627 run create_hlr_db(pid=7617): Terminated: ok {rc=0} 12:55:57.197396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7619): Launched 12:55:57.516296 run osmo-hlr_10.42.42.2(pid=7620): Launched 12:55:57.637204 run osmo-stp_10.42.42.5: Starting osmo-stp 12:55:58.186523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7622): Launched 12:55:58.503827 run osmo-stp_10.42.42.5(pid=7623): Launched 12:55:58.624905 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:55:59.172093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7625): Launched 12:55:59.293936 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:55:59.562228 run patchelf(pid=7626): Launched 12:55:59.738711 run osmo-stp_10.42.42.5(pid=7623): ERR: Terminated: ERROR {rc=1} [trial-2360↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7623)] 12:55:59.873810 run osmo-stp_10.42.42.5(pid=7623): stdout: | (launched: 2022-12-09_12:55:58.446245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:00.010479 run osmo-stp_10.42.42.5(pid=7623): stderr: | 20221209125558631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125558631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125558631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125558632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125558632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125558632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125558633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:00.147332 run osmo-stp_10.42.42.5(pid=7623): stdout: | (launched: 2022-12-09_12:55:58.446245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:00.278430 run osmo-stp_10.42.42.5(pid=7623): stderr: | 20221209125558631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125558631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125558631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125558632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125558632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125558632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125558633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:00.433792 run patchelf(pid=7626): Terminating (SIGINT) 12:56:00.612713 run patchelf(pid=7626): Terminated: ok {rc=0} 12:56:00.742044 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7623): Process ended prematurely: osmo-stp_10.42.42.5(pid=7623) [trial-2360↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7623)] [trial-2360↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:56:00.751317 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 12:56:00.779645 run osmo-hlr_10.42.42.2(pid=7620): ERR: Terminated: ERROR {rc=237} [trial-2360↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7620)] 12:56:00.830334 run osmo-hlr_10.42.42.2(pid=7620): stdout: | (launched: 2022-12-09_12:55:57.458209) 12:56:00.890126 run osmo-hlr_10.42.42.2(pid=7620): stderr: | 20221209125557651 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125557651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125557651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125557652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125557652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125557652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125557665 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125557673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125557673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125557673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:00.947334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7619): Terminating (SIGTERM) 12:56:00.993299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7622): Terminating (SIGTERM) 12:56:01.037087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7625): Terminating (SIGTERM) 12:56:01.080373 --- ParallelTerminationStrategy: PID 7619 died... 12:56:01.100876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7619): Terminated: ok {rc=0} 12:56:01.149030 --- ParallelTerminationStrategy: PID 7622 died... 12:56:01.168687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7622): Terminated: ok {rc=0} 12:56:01.214637 --- ParallelTerminationStrategy: PID 7625 died... 12:56:01.234258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7625): Terminated: ok {rc=0} 12:56:01.320352 bus /gobi_0: Setting Powered False 12:56:02.418616 bus /gobi_0: Setting Powered False 12:56:03.533436 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 12:56:04.771218 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:56:04.776703 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 12:56:04.797744 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 12:56:04.833134 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 12:56:04.885990 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 12:56:04.906449 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 12:56:04.941342 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 12:56:05.494417 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2360 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 12:56:05.499660 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:56:05.510555 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 12:56:05.567598 tst switch_tch_pdch.py: using LAC 21605 12:56:05.685176 tst switch_tch_pdch.py: using RAC 185 12:56:05.811234 tst switch_tch_pdch.py: using CellId 21605 12:56:05.938436 tst switch_tch_pdch.py: using BVCI 21606 12:56:06.046836 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:56:06.057817 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:56:06.068628 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:56:06.079490 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:56:06.090242 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:56:06.101099 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:56:06.112086 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:56:06.122718 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:56:06.241906 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:56:06.358943 tst switch_tch_pdch.py:51: start network... 12:56:06.573221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:07.039009 run create_hlr_db(pid=7631): Launched 12:56:07.160893 bus /gobi_6: Setting Powered False 12:56:08.224740 run create_hlr_db(pid=7631): Terminated: ok {rc=0} 12:56:08.626633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7633): Launched 12:56:08.924410 run osmo-hlr_10.42.42.2(pid=7634): Launched 12:56:09.037777 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:09.523973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7636): Launched 12:56:09.821371 run osmo-stp_10.42.42.5(pid=7637): Launched 12:56:09.934090 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:56:10.421467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7639): Launched 12:56:10.535137 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:56:10.786991 run patchelf(pid=7640): Launched 12:56:10.952474 run osmo-stp_10.42.42.5(pid=7637): ERR: Terminated: ERROR {rc=1} [trial-2360↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7637)] 12:56:11.078317 run osmo-stp_10.42.42.5(pid=7637): stdout: | (launched: 2022-12-09_12:56:09.766398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:11.205786 run osmo-stp_10.42.42.5(pid=7637): stderr: | 20221209125609931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125609931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125609932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125609932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125609933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125609933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125609933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:11.333235 run osmo-stp_10.42.42.5(pid=7637): stdout: | (launched: 2022-12-09_12:56:09.766398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:11.454977 run osmo-stp_10.42.42.5(pid=7637): stderr: | 20221209125609931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125609931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125609932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125609932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125609933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125609933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125609933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:11.599335 run patchelf(pid=7640): Terminating (SIGINT) 12:56:11.765453 run patchelf(pid=7640): Terminated: ok {rc=0} 12:56:11.885606 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=7637): Process ended prematurely: osmo-stp_10.42.42.5(pid=7637) [trial-2360↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7637)] [trial-2360↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 12:56:11.894404 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 12:56:11.920679 run osmo-hlr_10.42.42.2(pid=7634): ERR: Terminated: ERROR {rc=237} [trial-2360↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7634)] 12:56:11.968145 run osmo-hlr_10.42.42.2(pid=7634): stdout: | (launched: 2022-12-09_12:56:08.869490) 12:56:12.017224 run osmo-hlr_10.42.42.2(pid=7634): stderr: | 20221209125609040 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125609040 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125609040 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125609040 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125609040 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125609041 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125609057 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125609066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125609066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125609066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:12.066287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7633): Terminating (SIGTERM) 12:56:12.105943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7636): Terminating (SIGTERM) 12:56:12.145507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7639): Terminating (SIGTERM) 12:56:12.185341 --- ParallelTerminationStrategy: PID 7633 died... 12:56:12.204037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7633): Terminated: ok {rc=0} 12:56:12.247780 --- ParallelTerminationStrategy: PID 7636 died... 12:56:12.266450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7636): Terminated: ok {rc=0} 12:56:12.310303 --- ParallelTerminationStrategy: PID 7639 died... 12:56:12.329080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7639): Terminated: ok {rc=0} 12:56:12.413636 bus /gobi_0: Setting Powered False 12:56:13.511905 bus /gobi_0: Setting Powered False 12:56:14.625518 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_sms:oc2g --------------------------------------------------------------------- 12:56:15.875492 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:56:15.879828 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 12:56:15.910010 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 12:56:15.918156 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 12:56:15.973954 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 12:56:15.996630 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 12:56:16.005773 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 12:56:16.539056 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 12:56:16.544783 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 12:56:16.555503 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 12:56:16.590172 tst mo_mt_sms.py: using LAC 21606 12:56:16.710685 tst mo_mt_sms.py: using RAC 186 12:56:16.829602 tst mo_mt_sms.py: using CellId 21606 12:56:16.951190 tst mo_mt_sms.py: using BVCI 21607 12:56:17.061916 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 12:56:17.193252 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 12:56:17.312682 tst mo_mt_sms.py:9: start nitb and bts... 12:56:17.514721 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:56:18.122449 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7644): Launched 12:56:18.421203 run osmo-nitb_10.42.42.2(pid=7645): Launched 12:56:18.585783 run osmo-nitb_10.42.42.2(pid=7645): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7645)] 12:56:18.719188 run osmo-nitb_10.42.42.2(pid=7645): stdout: | (launched: 2022-12-09_12:56:18.366044) 12:56:18.864928 run osmo-nitb_10.42.42.2(pid=7645): stderr: | (launched: 2022-12-09_12:56:18.410606) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:56:19.009540 run osmo-nitb_10.42.42.2(pid=7645): stdout: | (launched: 2022-12-09_12:56:18.366044) 12:56:19.148045 run osmo-nitb_10.42.42.2(pid=7645): stderr: | (launched: 2022-12-09_12:56:18.410606) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7645): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7645) [trial-2360↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7645)] 12:56:19.533215 tst osmo-nitb_10.42.42.2(pid=7645): stdout: | (launched: 2022-12-09_12:56:18.366044) 12:56:19.661279 tst osmo-nitb_10.42.42.2(pid=7645): stderr: | (launched: 2022-12-09_12:56:18.410606) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:56:19.812353 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=7645): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7645) [trial-2360↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7645)] [trial-2360↪nitb_sms:oc2g↪mo_mt_sms.py:11] 12:56:19.821376 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 12:56:19.828385 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7644): Terminating (SIGTERM) 12:56:20.039844 --- ParallelTerminationStrategy: PID 7644 died... 12:56:20.061436 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7644): Terminated: ok {rc=0} 12:56:20.149392 bus /sierra_3: Setting Powered False 12:56:21.249091 bus /sierra_3: Setting Powered False 12:56:22.365714 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 sms:oc2g --------------------------------------------------------------------- 12:56:23.549140 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:56:23.553395 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 12:56:23.575063 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 12:56:23.602812 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 12:56:23.655227 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 12:56:23.676205 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 12:56:23.703705 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 12:56:24.249694 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 sms:oc2g mo_mt_sms.py ---------------------------------------------- 12:56:24.254781 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 12:56:24.265680 tst sms:oc2g: Using 1 x bts (candidates: 1) 12:56:24.300651 tst mo_mt_sms.py: using LAC 21607 12:56:24.424755 tst mo_mt_sms.py: using RAC 187 12:56:24.549223 tst mo_mt_sms.py: using CellId 21607 12:56:24.675761 tst mo_mt_sms.py: using BVCI 21608 12:56:24.790787 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 12:56:24.801921 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 12:56:24.812667 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 12:56:24.823679 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 12:56:24.834646 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 12:56:24.845717 tst sms:oc2g: Using 1 x modem (candidates: 2) 12:56:24.960447 tst sms:oc2g: Using 1 x modem (candidates: 2) 12:56:25.078615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:25.572239 run create_hlr_db(pid=7649): Launched 12:56:25.693058 bus /sierra_2: Setting Powered False 12:56:26.755980 run create_hlr_db(pid=7649): Terminated: ok {rc=0} 12:56:27.182622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7651): Launched 12:56:27.480237 run osmo-hlr_10.42.42.2(pid=7652): Launched 12:56:27.593508 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:28.103816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7654): Launched 12:56:28.400768 run osmo-stp_10.42.42.5(pid=7655): Launched 12:56:28.513123 run osmo-msc_10.42.42.6: Starting osmo-msc 12:56:29.052474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7657): Launched 12:56:29.350143 run osmo-msc_10.42.42.6(pid=7658): Launched 12:56:29.515785 run osmo-stp_10.42.42.5(pid=7655): ERR: Terminated: ERROR {rc=1} [trial-2360↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7655)] 12:56:29.642082 run osmo-stp_10.42.42.5(pid=7655): stdout: | (launched: 2022-12-09_12:56:28.345961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:29.768102 run osmo-stp_10.42.42.5(pid=7655): stderr: | 20221209125628511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125628512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125628512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125628512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125628513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125628513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125628513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:29.892386 run osmo-stp_10.42.42.5(pid=7655): stdout: | (launched: 2022-12-09_12:56:28.345961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:30.010371 run osmo-stp_10.42.42.5(pid=7655): stderr: | 20221209125628511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125628512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125628512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125628512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125628513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125628513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125628513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:30.151716 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=7655): Process ended prematurely: osmo-stp_10.42.42.5(pid=7655) [trial-2360↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7655)] [trial-2360↪sms:oc2g↪mo_mt_sms.py:16] 12:56:30.159778 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 12:56:30.185865 run osmo-hlr_10.42.42.2(pid=7652): ERR: Terminated: ERROR {rc=237} [trial-2360↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7652)] 12:56:30.233138 run osmo-hlr_10.42.42.2(pid=7652): stdout: | (launched: 2022-12-09_12:56:27.425540) 12:56:30.281835 run osmo-hlr_10.42.42.2(pid=7652): stderr: | 20221209125627597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125627597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125627597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125627597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125627597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125627597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125627609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125627618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125627618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125627618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:30.350046 run osmo-msc_10.42.42.6(pid=7658): ERR: Terminated: ERROR {rc=2} [trial-2360↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7658)] 12:56:30.397085 run osmo-msc_10.42.42.6(pid=7658): stdout: | (launched: 2022-12-09_12:56:29.295177) 12:56:30.445835 run osmo-msc_10.42.42.6(pid=7658): stderr: | 20221209125629564 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125629564 DLGLOBAL DEBUG validating counter group 0x7fbc901b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125629564 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125629564 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125629566 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125629566 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125629568 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125629568 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125629568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125629568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:56:30.495035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7651): Terminating (SIGTERM) 12:56:30.534270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7654): Terminating (SIGTERM) 12:56:30.573580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7657): Terminating (SIGTERM) 12:56:30.613166 --- ParallelTerminationStrategy: PID 7651 died... 12:56:30.631919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7651): Terminated: ok {rc=0} 12:56:30.675294 --- ParallelTerminationStrategy: PID 7654 died... 12:56:30.693637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7654): Terminated: ok {rc=0} 12:56:30.737480 --- ParallelTerminationStrategy: PID 7657 died... 12:56:30.755850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7657): Terminated: ok {rc=0} 12:56:30.851126 bus /sierra_3: Setting Powered False 12:56:31.966055 bus /sierra_3: Setting Powered False 12:56:33.078764 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_ussd:oc2g --------------------------------------------------------------------- 12:56:34.296511 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:56:34.300442 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 12:56:34.322322 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 12:56:34.329642 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 12:56:34.366272 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 12:56:34.387711 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 12:56:34.395340 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 12:56:34.913420 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2360 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 12:56:34.918982 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 12:56:34.930081 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 12:56:34.965092 tst assert_extension.py: using LAC 21608 12:56:35.094894 tst assert_extension.py: using RAC 188 12:56:35.212450 tst assert_extension.py: using CellId 21608 12:56:35.327587 tst assert_extension.py: using BVCI 21609 12:56:35.435346 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 12:56:35.551363 tst assert_extension.py:10: start nitb and bts... 12:56:35.766663 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:56:36.414298 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7663): Launched 12:56:36.732211 run osmo-nitb_10.42.42.2(pid=7664): Launched 12:56:36.908858 run osmo-nitb_10.42.42.2(pid=7664): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7664)] 12:56:37.051857 run osmo-nitb_10.42.42.2(pid=7664): stdout: | (launched: 2022-12-09_12:56:36.674236) 12:56:37.196568 run osmo-nitb_10.42.42.2(pid=7664): stderr: | (launched: 2022-12-09_12:56:36.721583) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:56:37.341642 run osmo-nitb_10.42.42.2(pid=7664): stdout: | (launched: 2022-12-09_12:56:36.674236) 12:56:37.480454 run osmo-nitb_10.42.42.2(pid=7664): stderr: | (launched: 2022-12-09_12:56:36.721583) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=7664): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7664) [trial-2360↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7664)] 12:56:37.851760 tst osmo-nitb_10.42.42.2(pid=7664): stdout: | (launched: 2022-12-09_12:56:36.674236) 12:56:37.980037 tst osmo-nitb_10.42.42.2(pid=7664): stderr: | (launched: 2022-12-09_12:56:36.721583) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:56:38.131301 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=7664): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7664) [trial-2360↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7664)] [trial-2360↪nitb_ussd:oc2g↪assert_extension.py:12] 12:56:38.140057 tst assert_extension.py:12: Test FAILED (3.2 sec) 12:56:38.147275 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7663): Terminating (SIGTERM) 12:56:38.358391 --- ParallelTerminationStrategy: PID 7663 died... 12:56:38.380271 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=7663): Terminated: ok {rc=0} 12:56:38.467965 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 ussd:oc2g --------------------------------------------------------------------- 12:56:39.627173 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:56:39.630973 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 12:56:39.651198 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 12:56:39.677912 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 12:56:39.712474 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 12:56:39.732923 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 12:56:39.759230 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 12:56:40.286750 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2360 ussd:oc2g assert_extension.py ---------------------------------------------- 12:56:40.291832 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 12:56:40.302470 tst ussd:oc2g: Using 1 x bts (candidates: 1) 12:56:40.336698 tst assert_extension.py: using LAC 21609 12:56:40.453718 tst assert_extension.py: using RAC 189 12:56:40.575555 tst assert_extension.py: using CellId 21609 12:56:40.692427 tst assert_extension.py: using BVCI 21610 12:56:40.799150 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 12:56:40.809612 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 12:56:40.819867 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 12:56:40.830064 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 12:56:40.840269 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 12:56:40.850530 tst ussd:oc2g: Using 1 x modem (candidates: 1) 12:56:40.966994 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:41.458493 run create_hlr_db(pid=7668): Launched 12:56:41.580342 bus /sierra_2: Setting Powered False 12:56:42.643536 run create_hlr_db(pid=7668): Terminated: ok {rc=0} 12:56:43.086993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7670): Launched 12:56:43.405018 run osmo-hlr_10.42.42.2(pid=7671): Launched 12:56:43.527139 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:44.082523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7673): Launched 12:56:44.401858 run osmo-stp_10.42.42.5(pid=7674): Launched 12:56:44.523121 run osmo-msc_10.42.42.6: Starting osmo-msc 12:56:45.096417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7676): Launched 12:56:45.417277 run osmo-msc_10.42.42.6(pid=7677): Launched 12:56:45.594425 run osmo-stp_10.42.42.5(pid=7674): ERR: Terminated: ERROR {rc=1} [trial-2360↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7674)] 12:56:45.727826 run osmo-stp_10.42.42.5(pid=7674): stdout: | (launched: 2022-12-09_12:56:44.343725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:45.900895 run osmo-stp_10.42.42.5(pid=7674): stderr: | 20221209125644531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125644531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125644531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125644532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125644532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125644532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125644532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:46.057466 run osmo-stp_10.42.42.5(pid=7674): stdout: | (launched: 2022-12-09_12:56:44.343725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:46.184828 run osmo-stp_10.42.42.5(pid=7674): stderr: | 20221209125644531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125644531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125644531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125644532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125644532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125644532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125644532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:46.333440 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=7674): Process ended prematurely: osmo-stp_10.42.42.5(pid=7674) [trial-2360↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7674)] [trial-2360↪ussd:oc2g↪assert_extension.py:17] 12:56:46.342971 tst assert_extension.py:17: Test FAILED (6.0 sec) 12:56:46.372170 run osmo-hlr_10.42.42.2(pid=7671): ERR: Terminated: ERROR {rc=237} [trial-2360↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7671)] 12:56:46.422957 run osmo-hlr_10.42.42.2(pid=7671): stdout: | (launched: 2022-12-09_12:56:43.346581) 12:56:46.474924 run osmo-hlr_10.42.42.2(pid=7671): stderr: | 20221209125643540 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125643540 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125643540 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125643540 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125643540 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125643541 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125643553 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125643561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125643562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125643562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:46.547610 run osmo-msc_10.42.42.6(pid=7677): ERR: Terminated: ERROR {rc=2} [trial-2360↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7677)] 12:56:46.598348 run osmo-msc_10.42.42.6(pid=7677): stdout: | (launched: 2022-12-09_12:56:45.358871) 12:56:46.650114 run osmo-msc_10.42.42.6(pid=7677): stderr: | 20221209125645679 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125645679 DLGLOBAL DEBUG validating counter group 0x7ffade2fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125645679 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125645679 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125645679 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125645680 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125645681 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125645682 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125645682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125645682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:56:46.704394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7670): Terminating (SIGTERM) 12:56:46.747218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7673): Terminating (SIGTERM) 12:56:46.791562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7676): Terminating (SIGTERM) 12:56:46.836238 --- ParallelTerminationStrategy: PID 7670 died... 12:56:46.856281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7670): Terminated: ok {rc=0} 12:56:46.905875 --- ParallelTerminationStrategy: PID 7673 died... 12:56:46.925354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7673): Terminated: ok {rc=0} 12:56:46.973707 --- ParallelTerminationStrategy: PID 7676 died... 12:56:46.993925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7676): Terminated: ok {rc=0} 12:56:47.081265 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:56:48.276400 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:56:48.283108 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:56:48.304884 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:56:48.331783 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:56:48.384133 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:56:48.404589 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:56:48.431194 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:56:48.983992 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:56:49.033470 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:49.044461 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:56:49.098112 tst mo_mt_call.py: using LAC 21610 12:56:49.215424 tst mo_mt_call.py: using RAC 190 12:56:49.332938 tst mo_mt_call.py: using CellId 21610 12:56:49.450528 tst mo_mt_call.py: using BVCI 21611 12:56:49.560280 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:49.571293 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:49.582025 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:49.592636 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:49.603440 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:49.614220 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:56:49.731553 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:56:49.851386 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:50.357292 run create_hlr_db(pid=7682): Launched 12:56:50.481543 bus /sierra_2: Setting Powered False 12:56:51.545342 run create_hlr_db(pid=7682): Terminated: ok {rc=0} 12:56:51.996432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7684): Launched 12:56:52.321728 run osmo-hlr_10.42.42.2(pid=7685): Launched 12:56:52.446239 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:53.005854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7687): Launched 12:56:53.330621 run osmo-stp_10.42.42.5(pid=7688): Launched 12:56:53.454746 run osmo-msc_10.42.42.6: Starting osmo-msc 12:56:54.041020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7690): Launched 12:56:54.366318 run osmo-msc_10.42.42.6(pid=7691): Launched 12:56:54.547281 run osmo-stp_10.42.42.5(pid=7688): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7688)] 12:56:54.684220 run osmo-stp_10.42.42.5(pid=7688): stdout: | (launched: 2022-12-09_12:56:53.270767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:54.821688 run osmo-stp_10.42.42.5(pid=7688): stderr: | 20221209125653458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125653458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125653458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125653459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125653459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125653459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125653459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:54.957156 run osmo-stp_10.42.42.5(pid=7688): stdout: | (launched: 2022-12-09_12:56:53.270767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:55.086662 run osmo-stp_10.42.42.5(pid=7688): stderr: | 20221209125653458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125653458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125653458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125653459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125653459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125653459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125653459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:55.241588 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7688): Process ended prematurely: osmo-stp_10.42.42.5(pid=7688) [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7688)] [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:56:55.251119 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:56:55.279394 run osmo-hlr_10.42.42.2(pid=7685): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7685)] 12:56:55.330571 run osmo-hlr_10.42.42.2(pid=7685): stdout: | (launched: 2022-12-09_12:56:52.261912) 12:56:55.383311 run osmo-hlr_10.42.42.2(pid=7685): stderr: | 20221209125652456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125652456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125652456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125652456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125652456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125652456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125652471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125652479 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125652479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125652480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:55.456193 run osmo-msc_10.42.42.6(pid=7691): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7691)] 12:56:55.506802 run osmo-msc_10.42.42.6(pid=7691): stdout: | (launched: 2022-12-09_12:56:54.307126) 12:56:55.559369 run osmo-msc_10.42.42.6(pid=7691): stderr: | 20221209125654624 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125654624 DLGLOBAL DEBUG validating counter group 0x7f5411fdec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125654625 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125654625 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125654625 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125654625 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125654627 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125654627 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125654627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125654627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:56:55.612146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7684): Terminating (SIGTERM) 12:56:55.654705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7687): Terminating (SIGTERM) 12:56:55.697363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7690): Terminating (SIGTERM) 12:56:55.740287 --- ParallelTerminationStrategy: PID 7684 died... 12:56:55.760405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7684): Terminated: ok {rc=0} 12:56:55.807493 --- ParallelTerminationStrategy: PID 7687 died... 12:56:55.827268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7687): Terminated: ok {rc=0} 12:56:55.874067 --- ParallelTerminationStrategy: PID 7690 died... 12:56:55.893851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7690): Terminated: ok {rc=0} 12:56:55.981851 bus /sierra_3: Setting Powered False 12:56:57.081357 bus /sierra_3: Setting Powered False 12:56:58.199205 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:56:59.350189 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:59.362301 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:56:59.419607 tst mo_mt_call_osmux.py: using LAC 21611 12:56:59.546684 tst mo_mt_call_osmux.py: using RAC 191 12:56:59.673802 tst mo_mt_call_osmux.py: using CellId 21611 12:56:59.800879 tst mo_mt_call_osmux.py: using BVCI 21612 12:56:59.918759 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:59.930374 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:59.941648 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:59.953109 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:59.964884 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:59.976441 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:57:00.097146 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:57:00.214155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:00.685598 run create_hlr_db(pid=7693): Launched 12:57:00.811135 bus /sierra_2: Setting Powered False 12:57:01.870613 run create_hlr_db(pid=7693): Terminated: ok {rc=0} 12:57:02.317575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7695): Launched 12:57:02.620712 run osmo-hlr_10.42.42.2(pid=7696): Launched 12:57:02.736238 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:03.262662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7698): Launched 12:57:03.565897 run osmo-stp_10.42.42.5(pid=7699): Launched 12:57:03.680868 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:04.227348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7701): Launched 12:57:04.530401 run osmo-msc_10.42.42.6(pid=7702): Launched 12:57:04.699340 run osmo-stp_10.42.42.5(pid=7699): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7699)] 12:57:04.827215 run osmo-stp_10.42.42.5(pid=7699): stdout: | (launched: 2022-12-09_12:57:03.509985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:04.955110 run osmo-stp_10.42.42.5(pid=7699): stderr: | 20221209125703677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125703677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125703678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125703678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125703679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125703679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125703679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:05.080928 run osmo-stp_10.42.42.5(pid=7699): stdout: | (launched: 2022-12-09_12:57:03.509985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:05.202402 run osmo-stp_10.42.42.5(pid=7699): stderr: | 20221209125703677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125703677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125703678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125703678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125703679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125703679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125703679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:05.347100 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7699): Process ended prematurely: osmo-stp_10.42.42.5(pid=7699) [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7699)] [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:57:05.355891 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 12:57:05.382267 run osmo-hlr_10.42.42.2(pid=7696): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7696)] 12:57:05.429784 run osmo-hlr_10.42.42.2(pid=7696): stdout: | (launched: 2022-12-09_12:57:02.564795) 12:57:05.479079 run osmo-hlr_10.42.42.2(pid=7696): stderr: | 20221209125702739 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125702739 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125702739 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125702739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125702739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125702739 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125702751 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125702760 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125702761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125702761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:05.548026 run osmo-msc_10.42.42.6(pid=7702): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7702)] 12:57:05.596580 run osmo-msc_10.42.42.6(pid=7702): stdout: | (launched: 2022-12-09_12:57:04.474655) 12:57:05.645763 run osmo-msc_10.42.42.6(pid=7702): stderr: | 20221209125704744 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125704744 DLGLOBAL DEBUG validating counter group 0x7fdab3caec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125704744 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125704744 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125704744 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125704745 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125704746 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125704747 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125704747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125704748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:57:05.695358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7695): Terminating (SIGTERM) 12:57:05.735068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7698): Terminating (SIGTERM) 12:57:05.774720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7701): Terminating (SIGTERM) 12:57:05.814777 --- ParallelTerminationStrategy: PID 7695 died... 12:57:05.833914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7695): Terminated: ok {rc=0} 12:57:05.877960 --- ParallelTerminationStrategy: PID 7698 died... 12:57:05.896439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7698): Terminated: ok {rc=0} 12:57:05.940313 --- ParallelTerminationStrategy: PID 7701 died... 12:57:05.959133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7701): Terminated: ok {rc=0} 12:57:06.044232 bus /sierra_3: Setting Powered False 12:57:07.144500 bus /sierra_3: Setting Powered False 12:57:08.260029 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:57:09.496744 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:57:09.504871 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:57:09.527046 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:57:09.554734 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:57:09.607232 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:57:09.628152 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:57:09.655598 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:57:10.207500 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:57:10.259597 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:57:10.271130 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:57:10.328264 tst mo_mt_call.py: using LAC 21612 12:57:10.456781 tst mo_mt_call.py: using RAC 192 12:57:10.583854 tst mo_mt_call.py: using CellId 21612 12:57:10.709847 tst mo_mt_call.py: using BVCI 21613 12:57:10.830022 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:57:10.841532 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:57:10.852731 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:57:10.864254 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:57:10.875831 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:57:10.887231 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:57:11.003645 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:57:11.123571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:11.627745 run create_hlr_db(pid=7707): Launched 12:57:11.751194 bus /sierra_2: Setting Powered False 12:57:12.815002 run create_hlr_db(pid=7707): Terminated: ok {rc=0} 12:57:13.249580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7709): Launched 12:57:13.553555 run osmo-hlr_10.42.42.2(pid=7710): Launched 12:57:13.670217 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:14.192800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7712): Launched 12:57:14.496352 run osmo-stp_10.42.42.5(pid=7713): Launched 12:57:14.612939 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:15.161691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7715): Launched 12:57:15.466362 run osmo-msc_10.42.42.6(pid=7716): Launched 12:57:15.636335 run osmo-stp_10.42.42.5(pid=7713): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7713)] 12:57:15.763941 run osmo-stp_10.42.42.5(pid=7713): stdout: | (launched: 2022-12-09_12:57:14.440425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:15.912243 run osmo-stp_10.42.42.5(pid=7713): stderr: | 20221209125714607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125714608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125714608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125714608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125714609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125714609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125714609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:16.058563 run osmo-stp_10.42.42.5(pid=7713): stdout: | (launched: 2022-12-09_12:57:14.440425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:16.193647 run osmo-stp_10.42.42.5(pid=7713): stderr: | 20221209125714607 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125714608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125714608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125714608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125714609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125714609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125714609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:16.355831 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7713): Process ended prematurely: osmo-stp_10.42.42.5(pid=7713) [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7713)] [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:57:16.366537 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:57:16.398651 run osmo-hlr_10.42.42.2(pid=7710): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7710)] 12:57:16.452697 run osmo-hlr_10.42.42.2(pid=7710): stdout: | (launched: 2022-12-09_12:57:13.497356) 12:57:16.508894 run osmo-hlr_10.42.42.2(pid=7710): stderr: | 20221209125713671 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125713671 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125713671 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125713671 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125713671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125713671 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125713683 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125713692 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125713692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125713692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:16.585667 run osmo-msc_10.42.42.6(pid=7716): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7716)] 12:57:16.639683 run osmo-msc_10.42.42.6(pid=7716): stdout: | (launched: 2022-12-09_12:57:15.410245) 12:57:16.695329 run osmo-msc_10.42.42.6(pid=7716): stderr: | 20221209125715680 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125715680 DLGLOBAL DEBUG validating counter group 0x7f2985eafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125715680 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125715680 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125715680 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125715681 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125715682 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125715683 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125715683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125715683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:57:16.752380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7709): Terminating (SIGTERM) 12:57:16.797983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7712): Terminating (SIGTERM) 12:57:16.844783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7715): Terminating (SIGTERM) 12:57:16.892565 --- ParallelTerminationStrategy: PID 7709 died... 12:57:16.914796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7709): Terminated: ok {rc=0} 12:57:16.966458 --- ParallelTerminationStrategy: PID 7712 died... 12:57:16.987230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7712): Terminated: ok {rc=0} 12:57:17.037950 --- ParallelTerminationStrategy: PID 7715 died... 12:57:17.058585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7715): Terminated: ok {rc=0} 12:57:17.152770 bus /sierra_3: Setting Powered False 12:57:18.249435 bus /sierra_3: Setting Powered False 12:57:19.362323 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:57:20.511600 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:57:20.523757 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:57:20.581590 tst mo_mt_call_osmux.py: using LAC 21613 12:57:20.706640 tst mo_mt_call_osmux.py: using RAC 193 12:57:20.828015 tst mo_mt_call_osmux.py: using CellId 21613 12:57:20.950854 tst mo_mt_call_osmux.py: using BVCI 21614 12:57:21.063204 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:57:21.074195 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:57:21.084859 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:57:21.096061 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:57:21.107442 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:57:21.118714 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:57:21.233819 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:57:21.357322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:21.861341 run create_hlr_db(pid=7718): Launched 12:57:21.986270 bus /sierra_2: Setting Powered False 12:57:23.050715 run create_hlr_db(pid=7718): Terminated: ok {rc=0} 12:57:23.502797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7720): Launched 12:57:23.826607 run osmo-hlr_10.42.42.2(pid=7721): Launched 12:57:23.950917 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:24.507141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7723): Launched 12:57:24.831170 run osmo-stp_10.42.42.5(pid=7724): Launched 12:57:24.954699 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:25.541133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7726): Launched 12:57:25.865417 run osmo-msc_10.42.42.6(pid=7727): Launched 12:57:26.046406 run osmo-stp_10.42.42.5(pid=7724): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7724)] 12:57:26.183785 run osmo-stp_10.42.42.5(pid=7724): stdout: | (launched: 2022-12-09_12:57:24.772029) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:26.322325 run osmo-stp_10.42.42.5(pid=7724): stderr: | 20221209125724960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125724961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125724961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125724961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125724962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125724962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125724962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:26.458098 run osmo-stp_10.42.42.5(pid=7724): stdout: | (launched: 2022-12-09_12:57:24.772029) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:26.587640 run osmo-stp_10.42.42.5(pid=7724): stderr: | 20221209125724960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125724961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125724961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125724961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125724962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125724962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125724962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:26.742323 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7724): Process ended prematurely: osmo-stp_10.42.42.5(pid=7724) [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7724)] [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:57:26.751731 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:57:26.780047 run osmo-hlr_10.42.42.2(pid=7721): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7721)] 12:57:26.830311 run osmo-hlr_10.42.42.2(pid=7721): stdout: | (launched: 2022-12-09_12:57:23.767655) 12:57:26.882263 run osmo-hlr_10.42.42.2(pid=7721): stderr: | 20221209125723961 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125723962 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125723962 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125723962 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125723962 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125723962 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125723974 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125723982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125723982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125723983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:26.954912 run osmo-msc_10.42.42.6(pid=7727): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7727)] 12:57:27.005251 run osmo-msc_10.42.42.6(pid=7727): stdout: | (launched: 2022-12-09_12:57:25.806373) 12:57:27.057161 run osmo-msc_10.42.42.6(pid=7727): stderr: | 20221209125726126 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125726126 DLGLOBAL DEBUG validating counter group 0x7f31046aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125726126 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125726126 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125726126 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125726126 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125726128 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125726128 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125726129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125726129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:57:27.109709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7720): Terminating (SIGTERM) 12:57:27.151516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7723): Terminating (SIGTERM) 12:57:27.193396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7726): Terminating (SIGTERM) 12:57:27.235524 --- ParallelTerminationStrategy: PID 7720 died... 12:57:27.255598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7720): Terminated: ok {rc=0} 12:57:27.302275 --- ParallelTerminationStrategy: PID 7723 died... 12:57:27.321750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7723): Terminated: ok {rc=0} 12:57:27.368672 --- ParallelTerminationStrategy: PID 7726 died... 12:57:27.388264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7726): Terminated: ok {rc=0} 12:57:27.477190 bus /sierra_3: Setting Powered False 12:57:28.574062 bus /sierra_3: Setting Powered False 12:57:29.690182 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:57:30.930805 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:57:30.941836 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:57:30.967402 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:57:30.999025 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:57:31.057866 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:57:31.080641 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:57:31.113105 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:57:31.659368 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:57:31.710523 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:31.722236 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:57:31.777350 tst mo_mt_call.py: using LAC 21614 12:57:31.933130 tst mo_mt_call.py: using RAC 194 12:57:32.064682 tst mo_mt_call.py: using CellId 21614 12:57:32.187153 tst mo_mt_call.py: using BVCI 21615 12:57:32.325137 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:32.338031 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:32.350556 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:32.365554 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:32.377897 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:32.389337 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:57:32.507772 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:57:32.622621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:33.094115 run create_hlr_db(pid=7733): Launched 12:57:33.218516 bus /sierra_2: Setting Powered False 12:57:34.278907 run create_hlr_db(pid=7733): Terminated: ok {rc=0} 12:57:34.701894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7735): Launched 12:57:35.028231 run osmo-hlr_10.42.42.2(pid=7736): Launched 12:57:35.152006 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:35.707179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7738): Launched 12:57:36.033581 run osmo-stp_10.42.42.5(pid=7742): Launched 12:57:36.157624 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:36.745352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7744): Launched 12:57:37.070556 run osmo-msc_10.42.42.6(pid=7745): Launched 12:57:37.251339 run osmo-stp_10.42.42.5(pid=7742): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7742)] 12:57:37.390402 run osmo-stp_10.42.42.5(pid=7742): stdout: | (launched: 2022-12-09_12:57:35.974376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:37.529660 run osmo-stp_10.42.42.5(pid=7742): stderr: | 20221209125736161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125736161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125736161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125736162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125736162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125736162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125736163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:37.665796 run osmo-stp_10.42.42.5(pid=7742): stdout: | (launched: 2022-12-09_12:57:35.974376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:37.795977 run osmo-stp_10.42.42.5(pid=7742): stderr: | 20221209125736161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125736161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125736161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125736162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125736162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125736162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125736163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:37.951856 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7742): Process ended prematurely: osmo-stp_10.42.42.5(pid=7742) [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7742)] [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:57:37.961407 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:57:37.989828 run osmo-hlr_10.42.42.2(pid=7736): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7736)] 12:57:38.040800 run osmo-hlr_10.42.42.2(pid=7736): stdout: | (launched: 2022-12-09_12:57:34.969241) 12:57:38.093543 run osmo-hlr_10.42.42.2(pid=7736): stderr: | 20221209125735163 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125735163 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125735163 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125735163 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125735163 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125735163 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125735176 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125735186 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125735186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125735186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:38.166823 run osmo-msc_10.42.42.6(pid=7745): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7745)] 12:57:38.217569 run osmo-msc_10.42.42.6(pid=7745): stdout: | (launched: 2022-12-09_12:57:37.011303) 12:57:38.270111 run osmo-msc_10.42.42.6(pid=7745): stderr: | 20221209125737331 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125737332 DLGLOBAL DEBUG validating counter group 0x7fcd2c514c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125737332 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125737332 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125737332 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125737332 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125737334 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125737334 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125737335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125737335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:57:38.323518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7735): Terminating (SIGTERM) 12:57:38.365972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7738): Terminating (SIGTERM) 12:57:38.408417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7744): Terminating (SIGTERM) 12:57:38.451097 --- ParallelTerminationStrategy: PID 7735 died... 12:57:38.471267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7735): Terminated: ok {rc=0} 12:57:38.518358 --- ParallelTerminationStrategy: PID 7738 died... 12:57:38.538105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7738): Terminated: ok {rc=0} 12:57:38.584884 --- ParallelTerminationStrategy: PID 7744 died... 12:57:38.604587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7744): Terminated: ok {rc=0} 12:57:38.693482 bus /sierra_3: Setting Powered False 12:57:39.792730 bus /sierra_3: Setting Powered False 12:57:40.909141 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:57:42.054300 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:42.065935 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:57:42.122062 tst mo_mt_call_osmux.py: using LAC 21615 12:57:42.246259 tst mo_mt_call_osmux.py: using RAC 195 12:57:42.365390 tst mo_mt_call_osmux.py: using CellId 21615 12:57:42.482833 tst mo_mt_call_osmux.py: using BVCI 21616 12:57:42.594528 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:42.605575 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:42.616268 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:42.626987 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:42.637746 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:42.648412 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:57:42.766522 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:57:42.883984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:43.355392 run create_hlr_db(pid=7747): Launched 12:57:43.479184 bus /sierra_2: Setting Powered False 12:57:44.539674 run create_hlr_db(pid=7747): Terminated: ok {rc=0} 12:57:44.982413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7749): Launched 12:57:45.308018 run osmo-hlr_10.42.42.2(pid=7750): Launched 12:57:45.433095 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:46.015008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7752): Launched 12:57:46.358312 run osmo-stp_10.42.42.5(pid=7753): Launched 12:57:46.590308 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:47.223857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7755): Launched 12:57:47.564616 run osmo-msc_10.42.42.6(pid=7756): Launched 12:57:47.747392 run osmo-stp_10.42.42.5(pid=7753): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7753)] 12:57:47.885191 run osmo-stp_10.42.42.5(pid=7753): stdout: | (launched: 2022-12-09_12:57:46.295495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:48.023155 run osmo-stp_10.42.42.5(pid=7753): stderr: | 20221209125746550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125746550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125746550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125746551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125746551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125746551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125746551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:48.159157 run osmo-stp_10.42.42.5(pid=7753): stdout: | (launched: 2022-12-09_12:57:46.295495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:48.288884 run osmo-stp_10.42.42.5(pid=7753): stderr: | 20221209125746550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125746550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125746550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125746551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125746551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125746551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125746551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:48.445245 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7753): Process ended prematurely: osmo-stp_10.42.42.5(pid=7753) [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7753)] [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:57:48.454753 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:57:48.483566 run osmo-hlr_10.42.42.2(pid=7750): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7750)] 12:57:48.534463 run osmo-hlr_10.42.42.2(pid=7750): stdout: | (launched: 2022-12-09_12:57:45.248613) 12:57:48.586811 run osmo-hlr_10.42.42.2(pid=7750): stderr: | 20221209125745441 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125745441 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125745441 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125745441 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125745441 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125745441 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125745454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125745462 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125745462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125745462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:48.659858 run osmo-msc_10.42.42.6(pid=7756): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7756)] 12:57:48.710560 run osmo-msc_10.42.42.6(pid=7756): stdout: | (launched: 2022-12-09_12:57:47.505368) 12:57:48.762911 run osmo-msc_10.42.42.6(pid=7756): stderr: | 20221209125747822 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125747822 DLGLOBAL DEBUG validating counter group 0x7fb572637c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125747822 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125747822 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125747822 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125747822 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125747824 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125747824 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125747824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125747825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:57:48.816007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7749): Terminating (SIGTERM) 12:57:48.858470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7752): Terminating (SIGTERM) 12:57:48.900848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7755): Terminating (SIGTERM) 12:57:48.943615 --- ParallelTerminationStrategy: PID 7749 died... 12:57:48.963970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7749): Terminated: ok {rc=0} 12:57:49.011337 --- ParallelTerminationStrategy: PID 7752 died... 12:57:49.031244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7752): Terminated: ok {rc=0} 12:57:49.078876 --- ParallelTerminationStrategy: PID 7755 died... 12:57:49.098706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7755): Terminated: ok {rc=0} 12:57:49.187017 bus /sierra_3: Setting Powered False 12:57:50.287368 bus /sierra_3: Setting Powered False 12:57:51.404321 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 12:57:52.632527 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:57:52.638965 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 12:57:52.659369 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 12:57:52.685870 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 12:57:52.735067 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 12:57:52.755284 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 12:57:52.781354 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 12:57:53.334955 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 12:57:53.390580 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:53.402489 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:57:53.462766 tst mo_mt_call.py: using LAC 21616 12:57:53.590306 tst mo_mt_call.py: using RAC 196 12:57:53.717146 tst mo_mt_call.py: using CellId 21616 12:57:53.843409 tst mo_mt_call.py: using BVCI 21617 12:57:53.961762 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:53.973278 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:53.984504 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:53.996172 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:54.007788 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:54.019422 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:57:54.137159 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:57:54.259460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:54.766061 run create_hlr_db(pid=7761): Launched 12:57:54.890045 bus /sierra_2: Setting Powered False 12:57:55.954075 run create_hlr_db(pid=7761): Terminated: ok {rc=0} 12:57:56.406549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7763): Launched 12:57:56.732290 run osmo-hlr_10.42.42.2(pid=7764): Launched 12:57:56.856273 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:57.421963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7766): Launched 12:57:57.746254 run osmo-stp_10.42.42.5(pid=7767): Launched 12:57:57.870499 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:58.457538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7769): Launched 12:57:58.782345 run osmo-msc_10.42.42.6(pid=7770): Launched 12:57:58.963953 run osmo-stp_10.42.42.5(pid=7767): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7767)] 12:57:59.101770 run osmo-stp_10.42.42.5(pid=7767): stdout: | (launched: 2022-12-09_12:57:57.687288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:59.240033 run osmo-stp_10.42.42.5(pid=7767): stderr: | 20221209125757874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125757874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125757874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125757875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125757875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125757875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125757875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:59.376611 run osmo-stp_10.42.42.5(pid=7767): stdout: | (launched: 2022-12-09_12:57:57.687288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:59.506493 run osmo-stp_10.42.42.5(pid=7767): stderr: | 20221209125757874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125757874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125757874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125757875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125757875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125757875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125757875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:59.662241 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7767): Process ended prematurely: osmo-stp_10.42.42.5(pid=7767) [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7767)] [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 12:57:59.671805 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:57:59.700542 run osmo-hlr_10.42.42.2(pid=7764): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7764)] 12:57:59.751635 run osmo-hlr_10.42.42.2(pid=7764): stdout: | (launched: 2022-12-09_12:57:56.673152) 12:57:59.803964 run osmo-hlr_10.42.42.2(pid=7764): stderr: | 20221209125756868 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125756868 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125756868 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125756868 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125756868 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125756868 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125756880 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125756888 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125756889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125756889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:59.877168 run osmo-msc_10.42.42.6(pid=7770): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7770)] 12:57:59.927801 run osmo-msc_10.42.42.6(pid=7770): stdout: | (launched: 2022-12-09_12:57:58.722969) 12:57:59.979795 run osmo-msc_10.42.42.6(pid=7770): stderr: | 20221209125759040 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125759040 DLGLOBAL DEBUG validating counter group 0x7fda944cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125759040 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125759040 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125759040 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125759041 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125759042 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125759043 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125759043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125759043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:58:00.032488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7763): Terminating (SIGTERM) 12:58:00.074973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7766): Terminating (SIGTERM) 12:58:00.117552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7769): Terminating (SIGTERM) 12:58:00.160234 --- ParallelTerminationStrategy: PID 7763 died... 12:58:00.180152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7763): Terminated: ok {rc=0} 12:58:00.227396 --- ParallelTerminationStrategy: PID 7766 died... 12:58:00.247251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7766): Terminated: ok {rc=0} 12:58:00.294149 --- ParallelTerminationStrategy: PID 7769 died... 12:58:00.314099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7769): Terminated: ok {rc=0} 12:58:00.402857 bus /sierra_3: Setting Powered False 12:58:01.500663 bus /sierra_3: Setting Powered False 12:58:02.619861 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 12:58:03.767603 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:58:03.779372 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:58:03.836260 tst mo_mt_call_osmux.py: using LAC 21617 12:58:03.957170 tst mo_mt_call_osmux.py: using RAC 197 12:58:04.077323 tst mo_mt_call_osmux.py: using CellId 21617 12:58:04.198915 tst mo_mt_call_osmux.py: using BVCI 21618 12:58:04.311056 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:58:04.322095 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:58:04.332836 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:58:04.343757 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:58:04.354650 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:58:04.365542 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:58:04.483218 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:58:04.600412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:05.073481 run create_hlr_db(pid=7772): Launched 12:58:05.197872 bus /sierra_2: Setting Powered False 12:58:06.258985 run create_hlr_db(pid=7772): Terminated: ok {rc=0} 12:58:06.703340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7774): Launched 12:58:07.028522 run osmo-hlr_10.42.42.2(pid=7775): Launched 12:58:07.153103 run osmo-stp_10.42.42.5: Starting osmo-stp 12:58:07.712460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7777): Launched 12:58:08.036463 run osmo-stp_10.42.42.5(pid=7778): Launched 12:58:08.159563 run osmo-msc_10.42.42.6: Starting osmo-msc 12:58:08.747341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7780): Launched 12:58:09.073243 run osmo-msc_10.42.42.6(pid=7781): Launched 12:58:09.255405 run osmo-stp_10.42.42.5(pid=7778): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7778)] 12:58:09.393655 run osmo-stp_10.42.42.5(pid=7778): stdout: | (launched: 2022-12-09_12:58:07.977092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:09.531158 run osmo-stp_10.42.42.5(pid=7778): stderr: | 20221209125808167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125808167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125808167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125808168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125808168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125808168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125808168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:09.667477 run osmo-stp_10.42.42.5(pid=7778): stdout: | (launched: 2022-12-09_12:58:07.977092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:09.796777 run osmo-stp_10.42.42.5(pid=7778): stderr: | 20221209125808167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125808167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125808167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125808168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125808168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125808168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125808168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:09.951690 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7778): Process ended prematurely: osmo-stp_10.42.42.5(pid=7778) [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7778)] [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 12:58:09.961327 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:58:09.990586 run osmo-hlr_10.42.42.2(pid=7775): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7775)] 12:58:10.041144 run osmo-hlr_10.42.42.2(pid=7775): stdout: | (launched: 2022-12-09_12:58:06.969468) 12:58:10.093875 run osmo-hlr_10.42.42.2(pid=7775): stderr: | 20221209125807162 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125807162 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125807162 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125807162 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125807162 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125807163 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125807175 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125807183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125807183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125807184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:58:10.166854 run osmo-msc_10.42.42.6(pid=7781): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7781)] 12:58:10.217654 run osmo-msc_10.42.42.6(pid=7781): stdout: | (launched: 2022-12-09_12:58:09.013748) 12:58:10.270090 run osmo-msc_10.42.42.6(pid=7781): stderr: | 20221209125809334 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125809334 DLGLOBAL DEBUG validating counter group 0x7f03a970fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125809334 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125809334 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125809334 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125809334 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125809336 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125809336 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125809336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125809337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:58:10.323407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7774): Terminating (SIGTERM) 12:58:10.365802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7777): Terminating (SIGTERM) 12:58:10.408231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7780): Terminating (SIGTERM) 12:58:10.450854 --- ParallelTerminationStrategy: PID 7774 died... 12:58:10.471114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7774): Terminated: ok {rc=0} 12:58:10.518428 --- ParallelTerminationStrategy: PID 7777 died... 12:58:10.538310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7777): Terminated: ok {rc=0} 12:58:10.585292 --- ParallelTerminationStrategy: PID 7780 died... 12:58:10.605183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7780): Terminated: ok {rc=0} 12:58:10.693845 bus /sierra_3: Setting Powered False 12:58:11.793461 bus /sierra_3: Setting Powered False 12:58:12.910317 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:58:14.150215 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:58:14.157727 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:58:14.178193 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:58:14.204652 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:58:14.257250 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:58:14.278092 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:58:14.304027 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:58:14.853268 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:58:14.901553 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:58:14.912401 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:58:14.972340 tst mo_mt_call.py: using LAC 21618 12:58:15.090395 tst mo_mt_call.py: using RAC 198 12:58:15.209373 tst mo_mt_call.py: using CellId 21618 12:58:15.329094 tst mo_mt_call.py: using BVCI 21619 12:58:15.449044 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:58:15.460667 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:58:15.472056 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:58:15.483938 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:58:15.495718 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:58:15.507921 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:58:15.623667 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:58:15.741641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:16.242964 run create_hlr_db(pid=7786): Launched 12:58:16.402703 bus /sierra_2: Setting Powered False 12:58:17.463243 run create_hlr_db(pid=7786): Terminated: ok {rc=0} 12:58:17.909512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7788): Launched 12:58:18.234813 run osmo-hlr_10.42.42.2(pid=7789): Launched 12:58:18.361562 run osmo-stp_10.42.42.5: Starting osmo-stp 12:58:18.922543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7791): Launched 12:58:19.249351 run osmo-stp_10.42.42.5(pid=7792): Launched 12:58:19.376555 run osmo-msc_10.42.42.6: Starting osmo-msc 12:58:19.967533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7794): Launched 12:58:20.294505 run osmo-msc_10.42.42.6(pid=7795): Launched 12:58:20.480189 run osmo-stp_10.42.42.5(pid=7792): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7792)] 12:58:20.618138 run osmo-stp_10.42.42.5(pid=7792): stdout: | (launched: 2022-12-09_12:58:19.189839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:20.756070 run osmo-stp_10.42.42.5(pid=7792): stderr: | 20221209125819381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125819381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125819381 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125819382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125819382 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125819382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125819382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:20.892344 run osmo-stp_10.42.42.5(pid=7792): stdout: | (launched: 2022-12-09_12:58:19.189839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:21.022961 run osmo-stp_10.42.42.5(pid=7792): stderr: | 20221209125819381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125819381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125819381 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125819382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125819382 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125819382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125819382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:21.178848 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7792): Process ended prematurely: osmo-stp_10.42.42.5(pid=7792) [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7792)] [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:58:21.188511 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:58:21.217664 run osmo-hlr_10.42.42.2(pid=7789): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7789)] 12:58:21.269069 run osmo-hlr_10.42.42.2(pid=7789): stdout: | (launched: 2022-12-09_12:58:18.175655) 12:58:21.321897 run osmo-hlr_10.42.42.2(pid=7789): stderr: | 20221209125818372 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125818372 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125818372 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125818373 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125818373 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125818373 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125818384 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125818393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125818394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125818394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:58:21.395611 run osmo-msc_10.42.42.6(pid=7795): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7795)] 12:58:21.446406 run osmo-msc_10.42.42.6(pid=7795): stdout: | (launched: 2022-12-09_12:58:20.235149) 12:58:21.498808 run osmo-msc_10.42.42.6(pid=7795): stderr: | 20221209125820554 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125820555 DLGLOBAL DEBUG validating counter group 0x7f20b394ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125820555 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125820555 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125820555 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125820555 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125820557 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125820557 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125820558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125820558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:58:21.551900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7788): Terminating (SIGTERM) 12:58:21.594882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7791): Terminating (SIGTERM) 12:58:21.637864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7794): Terminating (SIGTERM) 12:58:21.681144 --- ParallelTerminationStrategy: PID 7788 died... 12:58:21.701680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7788): Terminated: ok {rc=0} 12:58:21.749719 --- ParallelTerminationStrategy: PID 7791 died... 12:58:21.769808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7791): Terminated: ok {rc=0} 12:58:21.817295 --- ParallelTerminationStrategy: PID 7794 died... 12:58:21.837233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7794): Terminated: ok {rc=0} 12:58:21.925671 bus /sierra_3: Setting Powered False 12:58:23.024936 bus /sierra_3: Setting Powered False 12:58:24.141756 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:58:25.291319 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:58:25.303731 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:58:25.362374 tst mo_mt_call_osmux.py: using LAC 21619 12:58:25.492096 tst mo_mt_call_osmux.py: using RAC 199 12:58:25.620205 tst mo_mt_call_osmux.py: using CellId 21619 12:58:25.747483 tst mo_mt_call_osmux.py: using BVCI 21620 12:58:25.866903 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:58:25.878467 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:58:25.889705 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:58:25.901313 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:58:25.912707 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:58:25.924533 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:58:26.042043 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:58:26.156313 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:26.628815 run create_hlr_db(pid=7797): Launched 12:58:26.754029 bus /sierra_2: Setting Powered False 12:58:27.818075 run create_hlr_db(pid=7797): Terminated: ok {rc=0} 12:58:28.270002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7799): Launched 12:58:28.598081 run osmo-hlr_10.42.42.2(pid=7800): Launched 12:58:28.722659 run osmo-stp_10.42.42.5: Starting osmo-stp 12:58:29.260807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7802): Launched 12:58:29.566110 run osmo-stp_10.42.42.5(pid=7803): Launched 12:58:29.683167 run osmo-msc_10.42.42.6: Starting osmo-msc 12:58:30.234950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7805): Launched 12:58:30.539493 run osmo-msc_10.42.42.6(pid=7806): Launched 12:58:30.709969 run osmo-stp_10.42.42.5(pid=7803): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7803)] 12:58:30.838197 run osmo-stp_10.42.42.5(pid=7803): stdout: | (launched: 2022-12-09_12:58:29.509485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:31.040512 run osmo-stp_10.42.42.5(pid=7803): stderr: | 20221209125829677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125829677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125829677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125829677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125829678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125829678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125829678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:31.170241 run osmo-stp_10.42.42.5(pid=7803): stdout: | (launched: 2022-12-09_12:58:29.509485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:31.293602 run osmo-stp_10.42.42.5(pid=7803): stderr: | 20221209125829677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125829677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125829677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125829677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125829678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125829678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125829678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:31.442957 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7803): Process ended prematurely: osmo-stp_10.42.42.5(pid=7803) [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7803)] [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:58:31.452098 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:58:31.479326 run osmo-hlr_10.42.42.2(pid=7800): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7800)] 12:58:31.528008 run osmo-hlr_10.42.42.2(pid=7800): stdout: | (launched: 2022-12-09_12:58:28.538087) 12:58:31.578562 run osmo-hlr_10.42.42.2(pid=7800): stderr: | 20221209125828735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125828735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125828735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125828735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125828735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125828735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125828748 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125828756 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125828756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125828756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:58:31.649187 run osmo-msc_10.42.42.6(pid=7806): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7806)] 12:58:31.698552 run osmo-msc_10.42.42.6(pid=7806): stdout: | (launched: 2022-12-09_12:58:30.483547) 12:58:31.748719 run osmo-msc_10.42.42.6(pid=7806): stderr: | 20221209125830753 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125830753 DLGLOBAL DEBUG validating counter group 0x7f30ed514c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125830753 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125830753 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125830753 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125830753 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125830755 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125830756 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125830756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125830756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:58:31.801521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7799): Terminating (SIGTERM) 12:58:31.843798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7802): Terminating (SIGTERM) 12:58:31.887144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7805): Terminating (SIGTERM) 12:58:31.928275 --- ParallelTerminationStrategy: PID 7799 died... 12:58:31.947360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7799): Terminated: ok {rc=0} 12:58:31.993180 --- ParallelTerminationStrategy: PID 7802 died... 12:58:32.012511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7802): Terminated: ok {rc=0} 12:58:32.057418 --- ParallelTerminationStrategy: PID 7805 died... 12:58:32.076755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7805): Terminated: ok {rc=0} 12:58:32.170078 bus /sierra_3: Setting Powered False 12:58:33.277014 bus /sierra_3: Setting Powered False 12:58:34.391994 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:58:35.630062 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:58:35.636203 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:58:35.656526 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:58:35.683369 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:58:35.735494 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:58:35.755913 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:58:35.781943 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:58:36.333307 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:58:36.381980 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:36.393238 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:58:36.449132 tst mo_mt_call.py: using LAC 21620 12:58:36.573135 tst mo_mt_call.py: using RAC 200 12:58:36.692522 tst mo_mt_call.py: using CellId 21620 12:58:36.810309 tst mo_mt_call.py: using BVCI 21621 12:58:36.920794 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:36.931947 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:36.942839 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:36.953687 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:36.964505 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:36.975391 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:58:37.089060 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:58:37.207036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:37.679290 run create_hlr_db(pid=7811): Launched 12:58:37.804865 bus /sierra_2: Setting Powered False 12:58:38.865952 run create_hlr_db(pid=7811): Terminated: ok {rc=0} 12:58:39.310229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7813): Launched 12:58:39.638620 run osmo-hlr_10.42.42.2(pid=7814): Launched 12:58:39.763091 run osmo-stp_10.42.42.5: Starting osmo-stp 12:58:40.326013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7816): Launched 12:58:40.652895 run osmo-stp_10.42.42.5(pid=7817): Launched 12:58:40.779506 run osmo-msc_10.42.42.6: Starting osmo-msc 12:58:41.369333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7819): Launched 12:58:41.695443 run osmo-msc_10.42.42.6(pid=7820): Launched 12:58:41.877914 run osmo-stp_10.42.42.5(pid=7817): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7817)] 12:58:42.016148 run osmo-stp_10.42.42.5(pid=7817): stdout: | (launched: 2022-12-09_12:58:40.593540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:42.154618 run osmo-stp_10.42.42.5(pid=7817): stderr: | 20221209125840784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125840784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125840784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125840785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125840785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125840785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125840785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:42.290827 run osmo-stp_10.42.42.5(pid=7817): stdout: | (launched: 2022-12-09_12:58:40.593540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:42.421711 run osmo-stp_10.42.42.5(pid=7817): stderr: | 20221209125840784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125840784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125840784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125840785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125840785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125840785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125840785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:42.577462 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7817): Process ended prematurely: osmo-stp_10.42.42.5(pid=7817) [trial-2360↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7817)] [trial-2360↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:58:42.587135 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:58:42.615702 run osmo-hlr_10.42.42.2(pid=7814): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7814)] 12:58:42.666412 run osmo-hlr_10.42.42.2(pid=7814): stdout: | (launched: 2022-12-09_12:58:39.579178) 12:58:42.718776 run osmo-hlr_10.42.42.2(pid=7814): stderr: | 20221209125839775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125839775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125839775 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125839775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125839775 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125839775 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125839789 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125839799 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125839799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125839799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:58:42.791950 run osmo-msc_10.42.42.6(pid=7820): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7820)] 12:58:42.842593 run osmo-msc_10.42.42.6(pid=7820): stdout: | (launched: 2022-12-09_12:58:41.635934) 12:58:42.894901 run osmo-msc_10.42.42.6(pid=7820): stderr: | 20221209125841958 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125841958 DLGLOBAL DEBUG validating counter group 0x7fdcc6594c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125841958 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125841958 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125841958 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125841958 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125841960 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125841960 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125841961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125841961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:58:42.947736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7813): Terminating (SIGTERM) 12:58:42.990091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7816): Terminating (SIGTERM) 12:58:43.032449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7819): Terminating (SIGTERM) 12:58:43.075186 --- ParallelTerminationStrategy: PID 7813 died... 12:58:43.095355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7813): Terminated: ok {rc=0} 12:58:43.142595 --- ParallelTerminationStrategy: PID 7816 died... 12:58:43.162388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7816): Terminated: ok {rc=0} 12:58:43.209390 --- ParallelTerminationStrategy: PID 7819 died... 12:58:43.229211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7819): Terminated: ok {rc=0} 12:58:43.317057 bus /sierra_3: Setting Powered False 12:58:44.414885 bus /sierra_3: Setting Powered False 12:58:45.532650 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:58:46.679537 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:46.692357 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:58:46.753142 tst mo_mt_call_osmux.py: using LAC 21621 12:58:46.883457 tst mo_mt_call_osmux.py: using RAC 201 12:58:47.014579 tst mo_mt_call_osmux.py: using CellId 21621 12:58:47.170002 tst mo_mt_call_osmux.py: using BVCI 21622 12:58:47.283151 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:47.294253 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:47.305143 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:47.315919 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:47.326754 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:47.337587 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:58:47.453333 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:58:47.568391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:48.043304 run create_hlr_db(pid=7822): Launched 12:58:48.168868 bus /sierra_2: Setting Powered False 12:58:49.229987 run create_hlr_db(pid=7822): Terminated: ok {rc=0} 12:58:49.653981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7824): Launched 12:58:49.959015 run osmo-hlr_10.42.42.2(pid=7825): Launched 12:58:50.073605 run osmo-stp_10.42.42.5: Starting osmo-stp 12:58:50.595557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7827): Launched 12:58:50.899809 run osmo-stp_10.42.42.5(pid=7828): Launched 12:58:51.016422 run osmo-msc_10.42.42.6: Starting osmo-msc 12:58:51.567944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7830): Launched 12:58:51.874017 run osmo-msc_10.42.42.6(pid=7831): Launched 12:58:52.044418 run osmo-stp_10.42.42.5(pid=7828): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7828)] 12:58:52.172879 run osmo-stp_10.42.42.5(pid=7828): stdout: | (launched: 2022-12-09_12:58:50.844146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:52.301211 run osmo-stp_10.42.42.5(pid=7828): stderr: | 20221209125851012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125851012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125851012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125851013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125851013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125851013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125851013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:52.427850 run osmo-stp_10.42.42.5(pid=7828): stdout: | (launched: 2022-12-09_12:58:50.844146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:52.548775 run osmo-stp_10.42.42.5(pid=7828): stderr: | 20221209125851012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125851012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125851012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125851013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125851013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125851013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125851013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:52.693446 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7828): Process ended prematurely: osmo-stp_10.42.42.5(pid=7828) [trial-2360↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7828)] [trial-2360↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:58:52.702389 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:58:52.728883 run osmo-hlr_10.42.42.2(pid=7825): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7825)] 12:58:52.776329 run osmo-hlr_10.42.42.2(pid=7825): stdout: | (launched: 2022-12-09_12:58:49.901885) 12:58:52.825683 run osmo-hlr_10.42.42.2(pid=7825): stderr: | 20221209125850077 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125850077 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125850077 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125850077 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125850077 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125850077 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125850089 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125850098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125850098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125850098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:58:52.894652 run osmo-msc_10.42.42.6(pid=7831): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7831)] 12:58:52.942107 run osmo-msc_10.42.42.6(pid=7831): stdout: | (launched: 2022-12-09_12:58:51.817211) 12:58:52.991062 run osmo-msc_10.42.42.6(pid=7831): stderr: | 20221209125852090 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125852090 DLGLOBAL DEBUG validating counter group 0x7f2c4003bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125852090 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125852090 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125852090 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125852091 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125852092 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125852093 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125852093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125852093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:58:53.040612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7824): Terminating (SIGTERM) 12:58:53.080084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7827): Terminating (SIGTERM) 12:58:53.120200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7830): Terminating (SIGTERM) 12:58:53.160307 --- ParallelTerminationStrategy: PID 7824 died... 12:58:53.179653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7824): Terminated: ok {rc=0} 12:58:53.223836 --- ParallelTerminationStrategy: PID 7827 died... 12:58:53.242658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7827): Terminated: ok {rc=0} 12:58:53.286241 --- ParallelTerminationStrategy: PID 7830 died... 12:58:53.305176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7830): Terminated: ok {rc=0} 12:58:53.390961 bus /sierra_3: Setting Powered False 12:58:54.492027 bus /sierra_3: Setting Powered False 12:58:55.608178 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:58:56.848727 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:58:56.854925 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:58:56.877387 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 12:58:56.904942 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 12:58:56.958632 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:58:56.980245 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 12:58:57.008079 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 12:58:57.553428 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 12:58:57.603469 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:57.614535 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:58:57.672128 tst mo_mt_call.py: using LAC 21622 12:58:57.801743 tst mo_mt_call.py: using RAC 202 12:58:57.929423 tst mo_mt_call.py: using CellId 21622 12:58:58.051530 tst mo_mt_call.py: using BVCI 21623 12:58:58.164718 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:58.175788 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:58.186803 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:58.197578 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:58.208250 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:58.218925 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:58:58.335331 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:58:58.455034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:58.928734 run create_hlr_db(pid=7836): Launched 12:58:59.053062 bus /sierra_2: Setting Powered False 12:59:00.113905 run create_hlr_db(pid=7836): Terminated: ok {rc=0} 12:59:00.558867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7838): Launched 12:59:00.917823 run osmo-hlr_10.42.42.2(pid=7839): Launched 12:59:01.171324 run osmo-stp_10.42.42.5: Starting osmo-stp 12:59:01.822481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7841): Launched 12:59:02.164314 run osmo-stp_10.42.42.5(pid=7842): Launched 12:59:02.323474 run osmo-msc_10.42.42.6: Starting osmo-msc 12:59:02.878023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7844): Launched 12:59:03.182267 run osmo-msc_10.42.42.6(pid=7845): Launched 12:59:03.352538 run osmo-stp_10.42.42.5(pid=7842): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7842)] 12:59:03.481293 run osmo-stp_10.42.42.5(pid=7842): stdout: | (launched: 2022-12-09_12:59:02.105129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:03.609417 run osmo-stp_10.42.42.5(pid=7842): stderr: | 20221209125902314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125902314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125902314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125902314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125902315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125902315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125902315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:03.736253 run osmo-stp_10.42.42.5(pid=7842): stdout: | (launched: 2022-12-09_12:59:02.105129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:03.858111 run osmo-stp_10.42.42.5(pid=7842): stderr: | 20221209125902314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125902314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125902314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125902314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125902315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125902315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125902315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:04.003317 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7842): Process ended prematurely: osmo-stp_10.42.42.5(pid=7842) [trial-2360↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7842)] [trial-2360↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 12:59:04.012314 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:59:04.039091 run osmo-hlr_10.42.42.2(pid=7839): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7839)] 12:59:04.087632 run osmo-hlr_10.42.42.2(pid=7839): stdout: | (launched: 2022-12-09_12:59:00.827014) 12:59:04.137239 run osmo-hlr_10.42.42.2(pid=7839): stderr: | 20221209125901136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125901136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125901136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125901136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125901136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125901136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125901160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125901180 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125901181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125901181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:59:04.206405 run osmo-msc_10.42.42.6(pid=7845): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7845)] 12:59:04.254511 run osmo-msc_10.42.42.6(pid=7845): stdout: | (launched: 2022-12-09_12:59:03.126275) 12:59:04.303872 run osmo-msc_10.42.42.6(pid=7845): stderr: | 20221209125903398 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125903398 DLGLOBAL DEBUG validating counter group 0x7f38b2d64c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125903398 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125903398 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125903399 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125903399 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125903402 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125903402 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125903402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125903402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:59:04.353856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7838): Terminating (SIGTERM) 12:59:04.393665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7841): Terminating (SIGTERM) 12:59:04.433321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7844): Terminating (SIGTERM) 12:59:04.473827 --- ParallelTerminationStrategy: PID 7838 died... 12:59:04.493289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7838): Terminated: ok {rc=0} 12:59:04.537477 --- ParallelTerminationStrategy: PID 7841 died... 12:59:04.556092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7841): Terminated: ok {rc=0} 12:59:04.600733 --- ParallelTerminationStrategy: PID 7844 died... 12:59:04.619748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7844): Terminated: ok {rc=0} 12:59:04.705417 bus /sierra_3: Setting Powered False 12:59:05.806094 bus /sierra_3: Setting Powered False 12:59:06.921740 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 12:59:08.068334 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:59:08.080490 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:59:08.141210 tst mo_mt_call_osmux.py: using LAC 21623 12:59:08.264666 tst mo_mt_call_osmux.py: using RAC 203 12:59:08.387630 tst mo_mt_call_osmux.py: using CellId 21623 12:59:08.508204 tst mo_mt_call_osmux.py: using BVCI 21624 12:59:08.618605 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:59:08.629570 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:59:08.640229 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:59:08.650876 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:59:08.661515 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:59:08.672182 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:59:08.790370 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:59:08.907315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:59:09.380896 run create_hlr_db(pid=7847): Launched 12:59:09.505978 bus /sierra_2: Setting Powered False 12:59:10.566981 run create_hlr_db(pid=7847): Terminated: ok {rc=0} 12:59:11.012050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7849): Launched 12:59:11.341786 run osmo-hlr_10.42.42.2(pid=7850): Launched 12:59:11.467249 run osmo-stp_10.42.42.5: Starting osmo-stp 12:59:12.032714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7852): Launched 12:59:12.359418 run osmo-stp_10.42.42.5(pid=7853): Launched 12:59:12.485952 run osmo-msc_10.42.42.6: Starting osmo-msc 12:59:13.081445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7855): Launched 12:59:13.410780 run osmo-msc_10.42.42.6(pid=7856): Launched 12:59:13.594594 run osmo-stp_10.42.42.5(pid=7853): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7853)] 12:59:13.732712 run osmo-stp_10.42.42.5(pid=7853): stdout: | (launched: 2022-12-09_12:59:12.299499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:13.870972 run osmo-stp_10.42.42.5(pid=7853): stderr: | 20221209125912490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125912491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125912491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125912491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125912492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125912492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125912492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:14.007287 run osmo-stp_10.42.42.5(pid=7853): stdout: | (launched: 2022-12-09_12:59:12.299499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:14.137359 run osmo-stp_10.42.42.5(pid=7853): stderr: | 20221209125912490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125912491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125912491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125912491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125912492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125912492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125912492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:14.293421 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7853): Process ended prematurely: osmo-stp_10.42.42.5(pid=7853) [trial-2360↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7853)] [trial-2360↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 12:59:14.303194 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:59:14.331986 run osmo-hlr_10.42.42.2(pid=7850): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7850)] 12:59:14.383293 run osmo-hlr_10.42.42.2(pid=7850): stdout: | (launched: 2022-12-09_12:59:11.281776) 12:59:14.436011 run osmo-hlr_10.42.42.2(pid=7850): stderr: | 20221209125911479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125911479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125911479 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125911479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125911479 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125911479 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125911496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125911505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125911505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125911505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:59:14.509554 run osmo-msc_10.42.42.6(pid=7856): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7856)] 12:59:14.560548 run osmo-msc_10.42.42.6(pid=7856): stdout: | (launched: 2022-12-09_12:59:13.350404) 12:59:14.613273 run osmo-msc_10.42.42.6(pid=7856): stderr: | 20221209125913670 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125913670 DLGLOBAL DEBUG validating counter group 0x7f9d975bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125913671 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125913671 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125913671 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125913671 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125913673 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125913673 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125913673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125913673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:59:14.666252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7849): Terminating (SIGTERM) 12:59:14.708478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7852): Terminating (SIGTERM) 12:59:14.750934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7855): Terminating (SIGTERM) 12:59:14.793438 --- ParallelTerminationStrategy: PID 7849 died... 12:59:14.813761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7849): Terminated: ok {rc=0} 12:59:14.860858 --- ParallelTerminationStrategy: PID 7852 died... 12:59:14.881084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7852): Terminated: ok {rc=0} 12:59:14.927951 --- ParallelTerminationStrategy: PID 7855 died... 12:59:14.947823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7855): Terminated: ok {rc=0} 12:59:15.035956 bus /sierra_3: Setting Powered False 12:59:16.135474 bus /sierra_3: Setting Powered False 12:59:17.249990 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 emergency:oc2g --------------------------------------------------------------------- 12:59:18.485059 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:59:18.489882 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 12:59:18.511782 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 12:59:18.540001 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 12:59:18.627110 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 12:59:18.648368 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 12:59:18.677497 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 12:59:19.262338 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2360 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 12:59:19.269028 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:59:19.280789 tst emergency:oc2g: Using 1 x bts (candidates: 1) 12:59:19.319671 tst emergency_mo_mt_call.py: using LAC 21624 12:59:19.445413 tst emergency_mo_mt_call.py: using RAC 204 12:59:19.562533 tst emergency_mo_mt_call.py: using CellId 21624 12:59:19.678473 tst emergency_mo_mt_call.py: using BVCI 21625 12:59:19.786710 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:59:19.797477 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:59:19.808036 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:59:19.818607 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:59:19.829105 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:59:19.839364 tst emergency:oc2g: Using 1 x modem (candidates: 4) 12:59:19.956133 tst emergency:oc2g: Using 1 x modem (candidates: 4) 12:59:20.074697 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:59:20.571447 run create_hlr_db(pid=7861): Launched 12:59:20.694889 bus /sierra_2: Setting Powered False 12:59:21.757959 run create_hlr_db(pid=7861): Terminated: ok {rc=0} 12:59:22.186412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7863): Launched 12:59:22.488779 run osmo-hlr_10.42.42.2(pid=7864): Launched 12:59:22.603330 run osmo-stp_10.42.42.5: Starting osmo-stp 12:59:23.118655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7866): Launched 12:59:23.417368 run osmo-stp_10.42.42.5(pid=7867): Launched 12:59:23.541901 tst emergency_mo_mt_call.py: using MSISDN 7224 12:59:23.693843 run osmo-msc_10.42.42.6: Starting osmo-msc 12:59:24.233618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7869): Launched 12:59:24.533019 run osmo-msc_10.42.42.6(pid=7870): Launched 12:59:24.700656 run osmo-stp_10.42.42.5(pid=7867): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7867)] 12:59:24.826831 run osmo-stp_10.42.42.5(pid=7867): stdout: | (launched: 2022-12-09_12:59:23.362328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:24.953071 run osmo-stp_10.42.42.5(pid=7867): stderr: | 20221209125923529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125923529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125923530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125923530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125923531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125923531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125923531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:25.077350 run osmo-stp_10.42.42.5(pid=7867): stdout: | (launched: 2022-12-09_12:59:23.362328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:25.196578 run osmo-stp_10.42.42.5(pid=7867): stderr: | 20221209125923529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125923529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125923530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125923530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125923531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125923531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125923531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:25.338421 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=7867): Process ended prematurely: osmo-stp_10.42.42.5(pid=7867) [trial-2360↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7867)] [trial-2360↪emergency:oc2g↪emergency_mo_mt_call.py:19] 12:59:25.346621 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 12:59:25.372734 run osmo-hlr_10.42.42.2(pid=7864): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7864)] 12:59:25.420320 run osmo-hlr_10.42.42.2(pid=7864): stdout: | (launched: 2022-12-09_12:59:22.433257) 12:59:25.469663 run osmo-hlr_10.42.42.2(pid=7864): stderr: | 20221209125922606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125922606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125922606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125922606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125922606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125922607 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125922619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125922628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125922628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125922628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:59:25.538486 run osmo-msc_10.42.42.6(pid=7870): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7870)] 12:59:25.586180 run osmo-msc_10.42.42.6(pid=7870): stdout: | (launched: 2022-12-09_12:59:24.477789) 12:59:25.635182 run osmo-msc_10.42.42.6(pid=7870): stderr: | 20221209125924745 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125924745 DLGLOBAL DEBUG validating counter group 0x7f8ceb7b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125924746 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125924746 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125924746 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125924746 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125924748 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125924748 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125924748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125924748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:59:25.684779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7863): Terminating (SIGTERM) 12:59:25.724468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7866): Terminating (SIGTERM) 12:59:25.764108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7869): Terminating (SIGTERM) 12:59:25.804134 --- ParallelTerminationStrategy: PID 7863 died... 12:59:25.823407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7863): Terminated: ok {rc=0} 12:59:25.867527 --- ParallelTerminationStrategy: PID 7866 died... 12:59:25.886229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7866): Terminated: ok {rc=0} 12:59:25.930215 --- ParallelTerminationStrategy: PID 7869 died... 12:59:25.948887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7869): Terminated: ok {rc=0} 12:59:26.032334 bus /sierra_3: Setting Powered False 12:59:27.130633 bus /sierra_3: Setting Powered False 12:59:28.249576 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 12:59:29.337398 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:59:29.348457 tst emergency:oc2g: Using 1 x bts (candidates: 1) 12:59:29.390423 tst emergency_preemptive_call.py: using LAC 21625 12:59:29.506291 tst emergency_preemptive_call.py: using RAC 205 12:59:29.624192 tst emergency_preemptive_call.py: using CellId 21625 12:59:29.740050 tst emergency_preemptive_call.py: using BVCI 21626 12:59:29.847914 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:59:29.858543 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:59:29.868941 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:59:29.879335 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:59:29.889792 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 12:59:29.900092 tst emergency:oc2g: Using 1 x modem (candidates: 4) 12:59:30.016796 tst emergency:oc2g: Using 1 x modem (candidates: 4) 12:59:30.134711 tst emergency:oc2g: Using 1 x modem (candidates: 4) 12:59:30.251649 tst emergency:oc2g: Using 1 x modem (candidates: 4) 12:59:30.368338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:59:30.872425 run create_hlr_db(pid=7872): Launched 12:59:31.012124 bus /sierra_2: Setting Powered False 12:59:32.071570 run create_hlr_db(pid=7872): Terminated: ok {rc=0} 12:59:32.532330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7874): Launched 12:59:32.853853 run osmo-hlr_10.42.42.2(pid=7875): Launched 12:59:32.975296 run osmo-stp_10.42.42.5: Starting osmo-stp 12:59:33.530142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7877): Launched 12:59:33.853609 run osmo-stp_10.42.42.5(pid=7878): Launched 12:59:33.988382 tst emergency_preemptive_call.py: using MSISDN 7225 12:59:34.157434 run osmo-msc_10.42.42.6: Starting osmo-msc 12:59:34.733520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7880): Launched 12:59:35.054953 run osmo-msc_10.42.42.6(pid=7881): Launched 12:59:35.234809 run osmo-stp_10.42.42.5(pid=7878): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7878)] 12:59:35.374762 run osmo-stp_10.42.42.5(pid=7878): stdout: | (launched: 2022-12-09_12:59:33.794912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:35.509620 run osmo-stp_10.42.42.5(pid=7878): stderr: | 20221209125933985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125933985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125933986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125933986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125933987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125933987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125933987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:35.644349 run osmo-stp_10.42.42.5(pid=7878): stdout: | (launched: 2022-12-09_12:59:33.794912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:35.772487 run osmo-stp_10.42.42.5(pid=7878): stderr: | 20221209125933985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125933985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125933986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125933986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125933987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125933987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125933987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:35.925636 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=7878): Process ended prematurely: osmo-stp_10.42.42.5(pid=7878) [trial-2360↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7878)] [trial-2360↪emergency:oc2g↪emergency_preemptive_call.py:32] 12:59:35.934820 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 12:59:35.963751 run osmo-hlr_10.42.42.2(pid=7875): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7875)] 12:59:36.014996 run osmo-hlr_10.42.42.2(pid=7875): stdout: | (launched: 2022-12-09_12:59:32.794662) 12:59:36.068185 run osmo-hlr_10.42.42.2(pid=7875): stderr: | 20221209125932990 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125932990 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125932990 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125932991 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125932991 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125932991 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125933002 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125933011 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125933011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125933011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:59:36.142039 run osmo-msc_10.42.42.6(pid=7881): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=7881)] 12:59:36.193118 run osmo-msc_10.42.42.6(pid=7881): stdout: | (launched: 2022-12-09_12:59:34.996390) 12:59:36.246066 run osmo-msc_10.42.42.6(pid=7881): stderr: | 20221209125935315 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209125935315 DLGLOBAL DEBUG validating counter group 0x7f5161f37c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209125935316 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209125935316 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209125935316 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209125935316 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209125935318 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209125935318 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209125935318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209125935318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:59:36.299730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7874): Terminating (SIGTERM) 12:59:36.342875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7877): Terminating (SIGTERM) 12:59:36.386359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7880): Terminating (SIGTERM) 12:59:36.430122 --- ParallelTerminationStrategy: PID 7874 died... 12:59:36.450914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7874): Terminated: ok {rc=0} 12:59:36.498585 --- ParallelTerminationStrategy: PID 7877 died... 12:59:36.518523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7877): Terminated: ok {rc=0} 12:59:36.565859 --- ParallelTerminationStrategy: PID 7880 died... 12:59:36.585976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7880): Terminated: ok {rc=0} 12:59:36.675368 bus /sierra_9: Setting Powered False 12:59:37.773218 bus /sierra_9: Setting Powered False 12:59:38.890571 bus /sierra_8: Setting Powered False 12:59:39.988531 bus /sierra_8: Setting Powered False 12:59:41.104850 bus /sierra_3: Setting Powered False 12:59:42.202808 bus /sierra_3: Setting Powered False 12:59:43.321622 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:oc2g --------------------------------------------------------------------- 12:59:44.584566 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:59:44.588692 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 12:59:44.608889 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 12:59:44.647316 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 12:59:44.733069 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 12:59:44.753516 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 12:59:44.791530 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 12:59:45.379618 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 12:59:45.428891 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:45.439464 tst gprs:oc2g: Using 1 x bts (candidates: 1) 12:59:45.473719 tst cs_paging_gprs_active.py: using LAC 21626 12:59:45.593827 tst cs_paging_gprs_active.py: using RAC 206 12:59:45.713883 tst cs_paging_gprs_active.py: using CellId 21626 12:59:45.840802 tst cs_paging_gprs_active.py: using BVCI 21627 12:59:45.970455 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:45.982578 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:45.994415 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:46.007619 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:46.021758 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:46.033450 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:46.046269 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:46.060239 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:46.073890 tst gprs:oc2g: Using 1 x modem (candidates: 4) 12:59:46.197122 tst gprs:oc2g: Using 1 x modem (candidates: 4) 12:59:46.320738 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:59:46.550104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:59:46.885297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7887): Launched 12:59:47.179243 run iperf3-srv_10.42.42.10(pid=7888): Launched 12:59:47.302831 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:59:47.524664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:59:47.853488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7889): Launched 12:59:48.137707 run iperf3-srv_10.42.42.10(pid=7890): Launched 12:59:48.262221 tst cs_paging_gprs_active.py:38: start network... 12:59:48.484161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:59:48.990860 run create_hlr_db(pid=7891): Launched 12:59:49.115750 bus /sierra_2: Setting Powered False 12:59:50.179742 run create_hlr_db(pid=7891): Terminated: ok {rc=0} 12:59:50.633345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7893): Launched 12:59:50.960853 run osmo-hlr_10.42.42.2(pid=7894): Launched 12:59:51.087329 run osmo-stp_10.42.42.5: Starting osmo-stp 12:59:51.651507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7896): Launched 12:59:51.978553 run osmo-stp_10.42.42.5(pid=7897): Launched 12:59:52.104644 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:59:52.667876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7899): Launched 12:59:52.792683 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:59:53.068812 run patchelf(pid=7900): Launched 12:59:53.250749 run osmo-stp_10.42.42.5(pid=7897): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7897)] 12:59:53.389821 run osmo-stp_10.42.42.5(pid=7897): stdout: | (launched: 2022-12-09_12:59:51.919461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:53.529982 run osmo-stp_10.42.42.5(pid=7897): stderr: | 20221209125952107 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125952107 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125952108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125952108 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125952108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125952109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125952109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:53.670312 run osmo-stp_10.42.42.5(pid=7897): stdout: | (launched: 2022-12-09_12:59:51.919461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:53.804559 run osmo-stp_10.42.42.5(pid=7897): stderr: | 20221209125952107 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209125952107 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209125952108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209125952108 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209125952108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209125952109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209125952109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:53.963465 run patchelf(pid=7900): Terminating (SIGINT) 12:59:54.146743 run patchelf(pid=7900): Terminated: ok {rc=0} 12:59:54.278448 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7897): Process ended prematurely: osmo-stp_10.42.42.5(pid=7897) [trial-2360↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7897)] [trial-2360↪gprs:oc2g↪cs_paging_gprs_active.py:38] 12:59:54.288443 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 12:59:54.317947 run osmo-hlr_10.42.42.2(pid=7894): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7894)] 12:59:54.369059 run osmo-hlr_10.42.42.2(pid=7894): stdout: | (launched: 2022-12-09_12:59:50.901012) 12:59:54.421931 run osmo-hlr_10.42.42.2(pid=7894): stderr: | 20221209125951099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209125951099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209125951099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209125951099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209125951099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209125951099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209125951112 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209125951122 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209125951122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209125951122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:59:54.475015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7887): Terminating (SIGTERM) 12:59:54.517443 run iperf3-srv_10.42.42.10(pid=7888): Terminating (SIGTERM) 12:59:54.559629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7889): Terminating (SIGTERM) 12:59:54.602971 run iperf3-srv_10.42.42.10(pid=7890): Terminating (SIGTERM) 12:59:54.645819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7893): Terminating (SIGTERM) 12:59:54.688179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7896): Terminating (SIGTERM) 12:59:54.730629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7899): Terminating (SIGTERM) 12:59:54.773384 --- ParallelTerminationStrategy: PID 7887 died... 12:59:54.793724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7887): Terminated: ok {rc=0} 12:59:54.840791 --- ParallelTerminationStrategy: PID 7888 died... 12:59:54.861006 run iperf3-srv_10.42.42.10(pid=7888): Terminated {rc=256} 12:59:54.907353 --- ParallelTerminationStrategy: PID 7889 died... 12:59:54.926954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7889): Terminated: ok {rc=0} 12:59:54.973677 --- ParallelTerminationStrategy: PID 7890 died... 12:59:54.993383 run iperf3-srv_10.42.42.10(pid=7890): Terminated {rc=256} 12:59:55.039639 --- ParallelTerminationStrategy: PID 7893 died... 12:59:55.059291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7893): Terminated: ok {rc=0} 12:59:55.105646 --- ParallelTerminationStrategy: PID 7896 died... 12:59:55.125421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7896): Terminated: ok {rc=0} 12:59:55.171731 --- ParallelTerminationStrategy: PID 7899 died... 12:59:55.191523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7899): Terminated: ok {rc=0} 12:59:55.278747 bus /gobi_0: Setting Powered False 12:59:56.377501 bus /gobi_0: Setting Powered False 12:59:57.493621 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:oc2g iperf3.py ---------------------------------------------- 12:59:58.639914 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:58.650923 tst gprs:oc2g: Using 1 x bts (candidates: 1) 12:59:58.686051 tst iperf3.py: using LAC 21627 12:59:58.814788 tst iperf3.py: using RAC 207 12:59:58.944783 tst iperf3.py: using CellId 21627 12:59:59.078499 tst iperf3.py: using BVCI 21628 12:59:59.199059 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:59.210212 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:59.221067 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:59.232237 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:59.243240 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:59.254260 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:59.265379 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:59.276393 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 12:59:59.287574 tst gprs:oc2g: Using 1 x modem (candidates: 4) 12:59:59.404795 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:59:59.610800 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:59:59.918844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7901): Launched 13:00:00.183753 run iperf3-srv_10.42.42.10(pid=7902): Launched 13:00:00.297979 tst iperf3.py:8: start network... 13:00:00.501845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:00:01.001231 run create_hlr_db(pid=7903): Launched 13:00:01.166414 bus /gobi_6: Setting Powered False 13:00:02.229846 run create_hlr_db(pid=7903): Terminated: ok {rc=0} 13:00:02.663822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7908): Launched 13:00:02.969963 run osmo-hlr_10.42.42.2(pid=7909): Launched 13:00:03.089059 run osmo-stp_10.42.42.5: Starting osmo-stp 13:00:03.614625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7911): Launched 13:00:03.919881 run osmo-stp_10.42.42.5(pid=7912): Launched 13:00:04.036760 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:00:04.565701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7914): Launched 13:00:04.682238 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:00:04.940308 run patchelf(pid=7915): Launched 13:00:05.109852 run osmo-stp_10.42.42.5(pid=7912): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7912)] 13:00:05.239194 run osmo-stp_10.42.42.5(pid=7912): stdout: | (launched: 2022-12-09_13:00:03.863858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:05.369313 run osmo-stp_10.42.42.5(pid=7912): stderr: | 20221209130004032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130004032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130004032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130004033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130004033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130004033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130004033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:05.499934 run osmo-stp_10.42.42.5(pid=7912): stdout: | (launched: 2022-12-09_13:00:03.863858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:05.625297 run osmo-stp_10.42.42.5(pid=7912): stderr: | 20221209130004032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130004032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130004032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130004033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130004033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130004033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130004033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:05.773401 run patchelf(pid=7915): Terminating (SIGINT) 13:00:05.943809 run patchelf(pid=7915): Terminated: ok {rc=0} 13:00:06.066639 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7912): Process ended prematurely: osmo-stp_10.42.42.5(pid=7912) [trial-2360↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7912)] [trial-2360↪gprs:oc2g↪iperf3.py:8] 13:00:06.075944 tst iperf3.py:8: Test FAILED (7.5 sec) 13:00:06.103099 run osmo-hlr_10.42.42.2(pid=7909): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7909)] 13:00:06.150609 run osmo-hlr_10.42.42.2(pid=7909): stdout: | (launched: 2022-12-09_13:00:02.913917) 13:00:06.199727 run osmo-hlr_10.42.42.2(pid=7909): stderr: | 20221209130003087 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130003087 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130003087 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130003087 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130003087 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130003087 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130003099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130003107 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130003108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130003108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:00:06.249424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7901): Terminating (SIGTERM) 13:00:06.289253 run iperf3-srv_10.42.42.10(pid=7902): Terminating (SIGTERM) 13:00:06.328885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7908): Terminating (SIGTERM) 13:00:06.368670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7911): Terminating (SIGTERM) 13:00:06.408361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7914): Terminating (SIGTERM) 13:00:06.448814 --- ParallelTerminationStrategy: PID 7901 died... 13:00:06.467962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7901): Terminated: ok {rc=0} 13:00:06.511852 --- ParallelTerminationStrategy: PID 7902 died... 13:00:06.530902 run iperf3-srv_10.42.42.10(pid=7902): Terminated {rc=256} 13:00:06.575567 --- ParallelTerminationStrategy: PID 7908 died... 13:00:06.594393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7908): Terminated: ok {rc=0} 13:00:06.638042 --- ParallelTerminationStrategy: PID 7911 died... 13:00:06.656859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7911): Terminated: ok {rc=0} 13:00:06.701362 --- ParallelTerminationStrategy: PID 7914 died... 13:00:06.720075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7914): Terminated: ok {rc=0} 13:00:06.805082 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:oc2g iperf3m4.py ---------------------------------------------- 13:00:07.951840 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:07.962970 tst gprs:oc2g: Using 1 x bts (candidates: 1) 13:00:07.998856 tst iperf3m4.py: using LAC 21628 13:00:08.120377 tst iperf3m4.py: using RAC 208 13:00:08.243559 tst iperf3m4.py: using CellId 21628 13:00:08.365978 tst iperf3m4.py: using BVCI 21629 13:00:08.477348 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:08.487726 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:08.498107 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:08.508374 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:08.518643 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:08.528872 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:08.539262 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:08.549469 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:08.560581 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:00:08.675511 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:00:08.796030 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:00:08.918592 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:00:09.037752 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:00:09.258816 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:00:09.588777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7917): Launched 13:00:09.872446 run iperf3-srv_10.42.42.10(pid=7918): Launched 13:00:09.995422 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:00:10.215618 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:00:10.545434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7919): Launched 13:00:10.830033 run iperf3-srv_10.42.42.10(pid=7920): Launched 13:00:10.954491 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:00:11.174650 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:00:11.503419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7921): Launched 13:00:11.788866 run iperf3-srv_10.42.42.10(pid=7922): Launched 13:00:11.913551 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:00:12.133098 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:00:12.461694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7923): Launched 13:00:12.747767 run iperf3-srv_10.42.42.10(pid=7924): Launched 13:00:12.871082 tst iperf3m4.py:8: start network... 13:00:13.090967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:00:13.598241 run create_hlr_db(pid=7925): Launched 13:00:13.722893 bus /gobi_6: Setting Powered False 13:00:14.787252 run create_hlr_db(pid=7925): Terminated: ok {rc=0} 13:00:15.223026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7927): Launched 13:00:15.528695 run osmo-hlr_10.42.42.2(pid=7928): Launched 13:00:15.646079 run osmo-stp_10.42.42.5: Starting osmo-stp 13:00:16.188788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7930): Launched 13:00:16.515821 run osmo-stp_10.42.42.5(pid=7931): Launched 13:00:16.774388 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:00:17.374789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7933): Launched 13:00:17.492938 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:00:17.755107 run patchelf(pid=7934): Launched 13:00:17.926752 run osmo-stp_10.42.42.5(pid=7931): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7931)] 13:00:18.057308 run osmo-stp_10.42.42.5(pid=7931): stdout: | (launched: 2022-12-09_13:00:16.455688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:18.189429 run osmo-stp_10.42.42.5(pid=7931): stderr: | 20221209130016734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130016734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130016735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130016735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130016736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130016736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130016736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:18.321870 run osmo-stp_10.42.42.5(pid=7931): stdout: | (launched: 2022-12-09_13:00:16.455688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:18.448236 run osmo-stp_10.42.42.5(pid=7931): stderr: | 20221209130016734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130016734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130016735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130016735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130016736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130016736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130016736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:18.598654 run patchelf(pid=7934): Terminating (SIGINT) 13:00:18.771881 run patchelf(pid=7934): Terminated: ok {rc=0} 13:00:18.895956 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7931): Process ended prematurely: osmo-stp_10.42.42.5(pid=7931) [trial-2360↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7931)] [trial-2360↪gprs:oc2g↪iperf3m4.py:8] 13:00:18.905635 tst iperf3m4.py:8: Test FAILED (11.0 sec) 13:00:18.933623 run osmo-hlr_10.42.42.2(pid=7928): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7928)] 13:00:18.981760 run osmo-hlr_10.42.42.2(pid=7928): stdout: | (launched: 2022-12-09_13:00:15.472365) 13:00:19.031611 run osmo-hlr_10.42.42.2(pid=7928): stderr: | 20221209130015646 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130015646 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130015646 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130015646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130015646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130015646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130015658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130015667 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130015667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130015667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:00:19.081767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7917): Terminating (SIGTERM) 13:00:19.122615 run iperf3-srv_10.42.42.10(pid=7918): Terminating (SIGTERM) 13:00:19.163008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7919): Terminating (SIGTERM) 13:00:19.203021 run iperf3-srv_10.42.42.10(pid=7920): Terminating (SIGTERM) 13:00:19.243105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7921): Terminating (SIGTERM) 13:00:19.283223 run iperf3-srv_10.42.42.10(pid=7922): Terminating (SIGTERM) 13:00:19.323217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7923): Terminating (SIGTERM) 13:00:19.363277 run iperf3-srv_10.42.42.10(pid=7924): Terminating (SIGTERM) 13:00:19.403116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7927): Terminating (SIGTERM) 13:00:19.443153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7930): Terminating (SIGTERM) 13:00:19.483216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7933): Terminating (SIGTERM) 13:00:19.523888 --- ParallelTerminationStrategy: PID 7917 died... 13:00:19.543385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7917): Terminated: ok {rc=0} 13:00:19.587887 --- ParallelTerminationStrategy: PID 7918 died... 13:00:19.606757 run iperf3-srv_10.42.42.10(pid=7918): Terminated {rc=256} 13:00:19.651205 --- ParallelTerminationStrategy: PID 7919 died... 13:00:19.670192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7919): Terminated: ok {rc=0} 13:00:19.714473 --- ParallelTerminationStrategy: PID 7920 died... 13:00:19.733376 run iperf3-srv_10.42.42.10(pid=7920): Terminated {rc=256} 13:00:19.777591 --- ParallelTerminationStrategy: PID 7921 died... 13:00:19.796464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7921): Terminated: ok {rc=0} 13:00:19.840808 --- ParallelTerminationStrategy: PID 7922 died... 13:00:19.860081 run iperf3-srv_10.42.42.10(pid=7922): Terminated {rc=256} 13:00:19.904336 --- ParallelTerminationStrategy: PID 7923 died... 13:00:19.923075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7923): Terminated: ok {rc=0} 13:00:19.967678 --- ParallelTerminationStrategy: PID 7924 died... 13:00:19.986589 run iperf3-srv_10.42.42.10(pid=7924): Terminated {rc=256} 13:00:20.030780 --- ParallelTerminationStrategy: PID 7927 died... 13:00:20.049855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7927): Terminated: ok {rc=0} 13:00:20.094036 --- ParallelTerminationStrategy: PID 7930 died... 13:00:20.113219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7930): Terminated: ok {rc=0} 13:00:20.157864 --- ParallelTerminationStrategy: PID 7933 died... 13:00:20.176835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7933): Terminated: ok {rc=0} 13:00:20.263411 bus /gobi_4: Setting Powered False 13:00:21.363351 bus /gobi_4: Setting Powered False 13:00:22.480699 bus /gobi_1: Setting Powered False 13:00:23.580445 bus /gobi_1: Setting Powered False 13:00:24.696475 bus /gobi_0: Setting Powered False 13:00:25.796497 bus /gobi_0: Setting Powered False 13:00:26.913363 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:oc2g ping.py ---------------------------------------------- 13:00:28.017114 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:28.028090 tst gprs:oc2g: Using 1 x bts (candidates: 1) 13:00:28.062932 tst ping.py: using LAC 21629 13:00:28.181866 tst ping.py: using RAC 209 13:00:28.301122 tst ping.py: using CellId 21629 13:00:28.421182 tst ping.py: using BVCI 21630 13:00:28.530974 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:28.541764 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:28.552246 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:28.562745 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:28.573069 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:28.583360 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:28.593893 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:28.604305 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:00:28.719110 tst ping.py:19: start network... 13:00:28.922755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:00:29.392472 run create_hlr_db(pid=7935): Launched 13:00:29.518069 bus /gobi_6: Setting Powered False 13:00:30.578938 run create_hlr_db(pid=7935): Terminated: ok {rc=0} 13:00:31.062586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7937): Launched 13:00:31.389662 run osmo-hlr_10.42.42.2(pid=7938): Launched 13:00:31.636252 run osmo-stp_10.42.42.5: Starting osmo-stp 13:00:32.276372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7940): Launched 13:00:32.616813 run osmo-stp_10.42.42.5(pid=7941): Launched 13:00:32.742522 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:00:33.304144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7943): Launched 13:00:33.430982 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:00:33.706781 run patchelf(pid=7944): Launched 13:00:33.888912 run osmo-stp_10.42.42.5(pid=7941): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7941)] 13:00:34.027304 run osmo-stp_10.42.42.5(pid=7941): stdout: | (launched: 2022-12-09_13:00:32.556195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:34.167519 run osmo-stp_10.42.42.5(pid=7941): stderr: | 20221209130032749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130032749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130032749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130032749 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130032750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130032750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130032750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:34.307606 run osmo-stp_10.42.42.5(pid=7941): stdout: | (launched: 2022-12-09_13:00:32.556195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:34.441851 run osmo-stp_10.42.42.5(pid=7941): stderr: | 20221209130032749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130032749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130032749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130032749 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130032750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130032750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130032750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:34.600266 run patchelf(pid=7944): Terminating (SIGINT) 13:00:34.782587 run patchelf(pid=7944): Terminated: ok {rc=0} 13:00:34.913687 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=7941): Process ended prematurely: osmo-stp_10.42.42.5(pid=7941) [trial-2360↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7941)] [trial-2360↪gprs:oc2g↪ping.py:22] 13:00:34.923439 tst ping.py:22: Test FAILED (6.9 sec) 13:00:34.952699 run osmo-hlr_10.42.42.2(pid=7938): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7938)] 13:00:35.004311 run osmo-hlr_10.42.42.2(pid=7938): stdout: | (launched: 2022-12-09_13:00:31.327667) 13:00:35.057632 run osmo-hlr_10.42.42.2(pid=7938): stderr: | 20221209130031623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130031623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130031623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130031623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130031623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130031623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130031647 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130031655 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130031655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130031656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:00:35.111275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7937): Terminating (SIGTERM) 13:00:35.154960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7940): Terminating (SIGTERM) 13:00:35.198278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7943): Terminating (SIGTERM) 13:00:35.241568 --- ParallelTerminationStrategy: PID 7937 died... 13:00:35.262233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7937): Terminated: ok {rc=0} 13:00:35.310311 --- ParallelTerminationStrategy: PID 7940 died... 13:00:35.330547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7940): Terminated: ok {rc=0} 13:00:35.378343 --- ParallelTerminationStrategy: PID 7943 died... 13:00:35.398882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7943): Terminated: ok {rc=0} 13:00:35.488867 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 13:00:36.579028 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:36.590782 tst gprs:oc2g: Using 1 x bts (candidates: 1) 13:00:36.631627 tst ping_idle_ping.py: using LAC 21630 13:00:36.752170 tst ping_idle_ping.py: using RAC 210 13:00:36.871174 tst ping_idle_ping.py: using CellId 21630 13:00:36.991432 tst ping_idle_ping.py: using BVCI 21631 13:00:37.112221 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:37.123605 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:37.134836 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:37.146120 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:37.157602 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:37.169092 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:37.180259 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:00:37.191586 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:00:37.306709 tst ping_idle_ping.py:24: start network... 13:00:37.511731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:00:37.985935 run create_hlr_db(pid=7945): Launched 13:00:38.110717 bus /gobi_6: Setting Powered False 13:00:39.171663 run create_hlr_db(pid=7945): Terminated: ok {rc=0} 13:00:39.618982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7947): Launched 13:00:39.946037 run osmo-hlr_10.42.42.2(pid=7948): Launched 13:00:40.069433 run osmo-stp_10.42.42.5: Starting osmo-stp 13:00:40.599983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7950): Launched 13:00:40.905585 run osmo-stp_10.42.42.5(pid=7951): Launched 13:00:41.021823 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:00:41.548541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7953): Launched 13:00:41.665404 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:00:41.923207 run patchelf(pid=7954): Launched 13:00:42.093387 run osmo-stp_10.42.42.5(pid=7951): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7951)] 13:00:42.222918 run osmo-stp_10.42.42.5(pid=7951): stdout: | (launched: 2022-12-09_13:00:40.849292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:42.353070 run osmo-stp_10.42.42.5(pid=7951): stderr: | 20221209130041019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130041019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130041019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130041020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130041020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130041020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130041020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:42.483255 run osmo-stp_10.42.42.5(pid=7951): stdout: | (launched: 2022-12-09_13:00:40.849292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:42.607985 run osmo-stp_10.42.42.5(pid=7951): stderr: | 20221209130041019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130041019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130041019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130041020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130041020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130041020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130041020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:42.755637 run patchelf(pid=7954): Terminating (SIGINT) 13:00:42.926409 run patchelf(pid=7954): Terminated: ok {rc=0} 13:00:43.048837 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=7951): Process ended prematurely: osmo-stp_10.42.42.5(pid=7951) [trial-2360↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7951)] [trial-2360↪gprs:oc2g↪ping_idle_ping.py:27] 13:00:43.057906 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:00:43.084931 run osmo-hlr_10.42.42.2(pid=7948): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7948)] 13:00:43.133022 run osmo-hlr_10.42.42.2(pid=7948): stdout: | (launched: 2022-12-09_13:00:39.885728) 13:00:43.182545 run osmo-hlr_10.42.42.2(pid=7948): stderr: | 20221209130040084 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130040084 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130040084 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130040084 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130040084 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130040084 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130040100 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130040109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130040109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130040109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:00:43.232702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7947): Terminating (SIGTERM) 13:00:43.272699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7950): Terminating (SIGTERM) 13:00:43.312706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7953): Terminating (SIGTERM) 13:00:43.353179 --- ParallelTerminationStrategy: PID 7947 died... 13:00:43.372419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7947): Terminated: ok {rc=0} 13:00:43.416590 --- ParallelTerminationStrategy: PID 7950 died... 13:00:43.435520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7950): Terminated: ok {rc=0} 13:00:43.479898 --- ParallelTerminationStrategy: PID 7953 died... 13:00:43.498723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7953): Terminated: ok {rc=0} 13:00:43.584592 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 13:00:44.879792 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:00:44.885493 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:00:44.906454 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:00:44.944783 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:00:45.031040 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:00:45.051293 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:00:45.089334 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:00:45.685776 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:00:45.740866 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:45.752128 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:00:45.790263 tst cs_paging_gprs_active.py: using LAC 21631 13:00:45.918018 tst cs_paging_gprs_active.py: using RAC 211 13:00:46.049286 tst cs_paging_gprs_active.py: using CellId 21631 13:00:46.182422 tst cs_paging_gprs_active.py: using BVCI 21632 13:00:46.304911 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:46.317285 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:46.331305 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:46.344290 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:46.356117 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:46.368315 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:46.381140 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:46.393578 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:46.407055 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:00:46.559757 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:00:46.680777 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:00:46.894426 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:00:47.219335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7958): Launched 13:00:47.492801 run iperf3-srv_10.42.42.10(pid=7959): Launched 13:00:47.607868 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:00:47.812164 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:00:48.118581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7960): Launched 13:00:48.383778 run iperf3-srv_10.42.42.10(pid=7961): Launched 13:00:48.498557 tst cs_paging_gprs_active.py:38: start network... 13:00:48.703043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:00:49.178727 run create_hlr_db(pid=7962): Launched 13:00:49.303675 bus /gobi_6: Setting Powered False 13:00:50.363923 run create_hlr_db(pid=7962): Terminated: ok {rc=0} 13:00:50.808537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7964): Launched 13:00:51.134567 run osmo-hlr_10.42.42.2(pid=7965): Launched 13:00:51.259524 run osmo-stp_10.42.42.5: Starting osmo-stp 13:00:51.820400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7967): Launched 13:00:52.145912 run osmo-stp_10.42.42.5(pid=7968): Launched 13:00:52.269703 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:00:52.830606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7970): Launched 13:00:52.956378 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:00:53.230545 run patchelf(pid=7971): Launched 13:00:53.411733 run osmo-stp_10.42.42.5(pid=7968): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7968)] 13:00:53.549643 run osmo-stp_10.42.42.5(pid=7968): stdout: | (launched: 2022-12-09_13:00:52.086688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:53.688843 run osmo-stp_10.42.42.5(pid=7968): stderr: | 20221209130052276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130052276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130052277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130052277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130052277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130052278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130052278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:53.828049 run osmo-stp_10.42.42.5(pid=7968): stdout: | (launched: 2022-12-09_13:00:52.086688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:53.961697 run osmo-stp_10.42.42.5(pid=7968): stderr: | 20221209130052276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130052276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130052277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130052277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130052277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130052278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130052278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:54.119993 run patchelf(pid=7971): Terminating (SIGINT) 13:00:54.301102 run patchelf(pid=7971): Terminated: ok {rc=0} 13:00:54.432398 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=7968): Process ended prematurely: osmo-stp_10.42.42.5(pid=7968) [trial-2360↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7968)] [trial-2360↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:00:54.442811 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:00:54.471906 run osmo-hlr_10.42.42.2(pid=7965): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7965)] 13:00:54.522514 run osmo-hlr_10.42.42.2(pid=7965): stdout: | (launched: 2022-12-09_13:00:51.075406) 13:00:54.575185 run osmo-hlr_10.42.42.2(pid=7965): stderr: | 20221209130051270 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130051270 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130051270 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130051270 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130051270 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130051270 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130051282 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130051291 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130051291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130051291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:00:54.628370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7958): Terminating (SIGTERM) 13:00:54.671148 run iperf3-srv_10.42.42.10(pid=7959): Terminating (SIGTERM) 13:00:54.713882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7960): Terminating (SIGTERM) 13:00:54.756541 run iperf3-srv_10.42.42.10(pid=7961): Terminating (SIGTERM) 13:00:54.798971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7964): Terminating (SIGTERM) 13:00:54.841825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7967): Terminating (SIGTERM) 13:00:54.884273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7970): Terminating (SIGTERM) 13:00:54.926834 --- ParallelTerminationStrategy: PID 7958 died... 13:00:54.946921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7958): Terminated: ok {rc=0} 13:00:54.994035 --- ParallelTerminationStrategy: PID 7959 died... 13:00:55.013467 run iperf3-srv_10.42.42.10(pid=7959): Terminated {rc=256} 13:00:55.060037 --- ParallelTerminationStrategy: PID 7960 died... 13:00:55.079597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7960): Terminated: ok {rc=0} 13:00:55.126393 --- ParallelTerminationStrategy: PID 7961 died... 13:00:55.146169 run iperf3-srv_10.42.42.10(pid=7961): Terminated {rc=256} 13:00:55.192794 --- ParallelTerminationStrategy: PID 7964 died... 13:00:55.212832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7964): Terminated: ok {rc=0} 13:00:55.259609 --- ParallelTerminationStrategy: PID 7967 died... 13:00:55.279361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7967): Terminated: ok {rc=0} 13:00:55.326543 --- ParallelTerminationStrategy: PID 7970 died... 13:00:55.346495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7970): Terminated: ok {rc=0} 13:00:55.435894 bus /gobi_0: Setting Powered False 13:00:56.536493 bus /gobi_0: Setting Powered False 13:00:57.655910 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:00:58.803528 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:58.814910 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:00:58.856634 tst iperf3.py: using LAC 21632 13:00:58.975588 tst iperf3.py: using RAC 212 13:00:59.096838 tst iperf3.py: using CellId 21632 13:00:59.216487 tst iperf3.py: using BVCI 21633 13:00:59.327004 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:59.337757 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:59.348387 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:59.358987 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:59.369393 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:59.380243 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:59.390867 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:59.401853 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:59.412406 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:00:59.532156 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:00:59.751002 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:01:00.077726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7972): Launched 13:01:00.360457 run iperf3-srv_10.42.42.10(pid=7973): Launched 13:01:00.483520 tst iperf3.py:8: start network... 13:01:00.702352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:01:01.219694 run create_hlr_db(pid=7974): Launched 13:01:01.386223 bus /gobi_6: Setting Powered False 13:01:02.446706 run create_hlr_db(pid=7974): Terminated: ok {rc=0} 13:01:02.870889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7976): Launched 13:01:03.175151 run osmo-hlr_10.42.42.2(pid=7977): Launched 13:01:03.290536 run osmo-stp_10.42.42.5: Starting osmo-stp 13:01:03.826656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7979): Launched 13:01:04.132168 run osmo-stp_10.42.42.5(pid=7980): Launched 13:01:04.247273 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:01:04.770284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7982): Launched 13:01:04.888133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:01:05.145416 run patchelf(pid=7983): Launched 13:01:05.313633 run osmo-stp_10.42.42.5(pid=7980): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7980)] 13:01:05.442405 run osmo-stp_10.42.42.5(pid=7980): stdout: | (launched: 2022-12-09_13:01:04.076198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:05.572365 run osmo-stp_10.42.42.5(pid=7980): stderr: | 20221209130104244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130104244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130104244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130104244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130104245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130104245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130104245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:05.702612 run osmo-stp_10.42.42.5(pid=7980): stdout: | (launched: 2022-12-09_13:01:04.076198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:05.827442 run osmo-stp_10.42.42.5(pid=7980): stderr: | 20221209130104244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130104244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130104244 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130104244 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130104245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130104245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130104245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:05.975273 run patchelf(pid=7983): Terminating (SIGINT) 13:01:06.145284 run patchelf(pid=7983): Terminated: ok {rc=0} 13:01:06.267582 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7980): Process ended prematurely: osmo-stp_10.42.42.5(pid=7980) [trial-2360↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7980)] [trial-2360↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 13:01:06.277122 tst iperf3.py:8: Test FAILED (7.5 sec) 13:01:06.303897 run osmo-hlr_10.42.42.2(pid=7977): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7977)] 13:01:06.351330 run osmo-hlr_10.42.42.2(pid=7977): stdout: | (launched: 2022-12-09_13:01:03.119561) 13:01:06.400873 run osmo-hlr_10.42.42.2(pid=7977): stderr: | 20221209130103294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130103294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130103294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130103294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130103294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130103294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130103306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130103317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130103317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130103317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:01:06.450935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7972): Terminating (SIGTERM) 13:01:06.490848 run iperf3-srv_10.42.42.10(pid=7973): Terminating (SIGTERM) 13:01:06.530606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7976): Terminating (SIGTERM) 13:01:06.570478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7979): Terminating (SIGTERM) 13:01:06.610310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7982): Terminating (SIGTERM) 13:01:06.650427 --- ParallelTerminationStrategy: PID 7972 died... 13:01:06.669748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7972): Terminated: ok {rc=0} 13:01:06.714313 --- ParallelTerminationStrategy: PID 7973 died... 13:01:06.733088 run iperf3-srv_10.42.42.10(pid=7973): Terminated {rc=256} 13:01:06.777155 --- ParallelTerminationStrategy: PID 7976 died... 13:01:06.795928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7976): Terminated: ok {rc=0} 13:01:06.840215 --- ParallelTerminationStrategy: PID 7979 died... 13:01:06.858960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7979): Terminated: ok {rc=0} 13:01:06.903370 --- ParallelTerminationStrategy: PID 7982 died... 13:01:06.922249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=7982): Terminated: ok {rc=0} 13:01:07.006738 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:01:08.157181 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:08.169146 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:01:08.208174 tst iperf3m4.py: using LAC 21633 13:01:08.336585 tst iperf3m4.py: using RAC 213 13:01:08.465279 tst iperf3m4.py: using CellId 21633 13:01:08.593642 tst iperf3m4.py: using BVCI 21634 13:01:08.712287 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:08.723548 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:08.734707 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:08.746128 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:08.757294 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:08.768323 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:08.779775 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:08.790832 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:08.802350 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:01:08.922404 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:01:09.043396 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:01:09.161769 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:01:09.276398 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:01:09.479892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:01:09.787073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7984): Launched 13:01:10.054947 run iperf3-srv_10.42.42.10(pid=7985): Launched 13:01:10.171220 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:01:10.374482 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:01:10.680442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7986): Launched 13:01:10.945356 run iperf3-srv_10.42.42.10(pid=7987): Launched 13:01:11.059925 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:01:11.263612 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:01:11.569813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7988): Launched 13:01:11.836486 run iperf3-srv_10.42.42.10(pid=7989): Launched 13:01:11.951152 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:01:12.154080 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:01:12.460287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7990): Launched 13:01:12.725138 run iperf3-srv_10.42.42.10(pid=7991): Launched 13:01:12.838911 tst iperf3m4.py:8: start network... 13:01:13.041957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:01:13.514856 run create_hlr_db(pid=7992): Launched 13:01:13.641241 bus /gobi_6: Setting Powered False 13:01:14.701672 run create_hlr_db(pid=7992): Terminated: ok {rc=0} 13:01:15.145361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7994): Launched 13:01:15.471026 run osmo-hlr_10.42.42.2(pid=7995): Launched 13:01:15.597393 run osmo-stp_10.42.42.5: Starting osmo-stp 13:01:16.176543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7997): Launched 13:01:16.503294 run osmo-stp_10.42.42.5(pid=7998): Launched 13:01:16.889848 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:01:17.542354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8000): Launched 13:01:17.670435 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:01:17.945452 run patchelf(pid=8001): Launched 13:01:18.127597 run osmo-stp_10.42.42.5(pid=7998): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7998)] 13:01:18.266430 run osmo-stp_10.42.42.5(pid=7998): stdout: | (launched: 2022-12-09_13:01:16.445508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:18.406452 run osmo-stp_10.42.42.5(pid=7998): stderr: | 20221209130116746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130116747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130116747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130116748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130116750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130116750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130116750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:18.547509 run osmo-stp_10.42.42.5(pid=7998): stdout: | (launched: 2022-12-09_13:01:16.445508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:18.682185 run osmo-stp_10.42.42.5(pid=7998): stderr: | 20221209130116746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130116747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130116747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130116748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130116750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130116750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130116750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:18.841641 run patchelf(pid=8001): Terminating (SIGINT) 13:01:19.024289 run patchelf(pid=8001): Terminated: ok {rc=0} 13:01:19.156165 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=7998): Process ended prematurely: osmo-stp_10.42.42.5(pid=7998) [trial-2360↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7998)] [trial-2360↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 13:01:19.166560 tst iperf3m4.py:8: Test FAILED (11.0 sec) 13:01:19.195880 run osmo-hlr_10.42.42.2(pid=7995): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=7995)] 13:01:19.246540 run osmo-hlr_10.42.42.2(pid=7995): stdout: | (launched: 2022-12-09_13:01:15.411353) 13:01:19.298662 run osmo-hlr_10.42.42.2(pid=7995): stderr: | 20221209130115606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130115606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130115606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130115606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130115606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130115606 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130115619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130115628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130115629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130115629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:01:19.351602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7984): Terminating (SIGTERM) 13:01:19.394029 run iperf3-srv_10.42.42.10(pid=7985): Terminating (SIGTERM) 13:01:19.436370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7986): Terminating (SIGTERM) 13:01:19.479696 run iperf3-srv_10.42.42.10(pid=7987): Terminating (SIGTERM) 13:01:19.523422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7988): Terminating (SIGTERM) 13:01:19.566096 run iperf3-srv_10.42.42.10(pid=7989): Terminating (SIGTERM) 13:01:19.608190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7990): Terminating (SIGTERM) 13:01:19.650624 run iperf3-srv_10.42.42.10(pid=7991): Terminating (SIGTERM) 13:01:19.692682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7994): Terminating (SIGTERM) 13:01:19.735422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7997): Terminating (SIGTERM) 13:01:19.777819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8000): Terminating (SIGTERM) 13:01:19.820591 --- ParallelTerminationStrategy: PID 7984 died... 13:01:19.840833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7984): Terminated: ok {rc=0} 13:01:19.888383 --- ParallelTerminationStrategy: PID 7985 died... 13:01:19.908258 run iperf3-srv_10.42.42.10(pid=7985): Terminated {rc=256} 13:01:19.955386 --- ParallelTerminationStrategy: PID 7986 died... 13:01:19.975117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7986): Terminated: ok {rc=0} 13:01:20.022091 --- ParallelTerminationStrategy: PID 7987 died... 13:01:20.041935 run iperf3-srv_10.42.42.10(pid=7987): Terminated {rc=256} 13:01:20.088660 --- ParallelTerminationStrategy: PID 7988 died... 13:01:20.108339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7988): Terminated: ok {rc=0} 13:01:20.155212 --- ParallelTerminationStrategy: PID 7989 died... 13:01:20.174848 run iperf3-srv_10.42.42.10(pid=7989): Terminated {rc=256} 13:01:20.221848 --- ParallelTerminationStrategy: PID 7990 died... 13:01:20.241570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=7990): Terminated: ok {rc=0} 13:01:20.288638 --- ParallelTerminationStrategy: PID 7991 died... 13:01:20.308452 run iperf3-srv_10.42.42.10(pid=7991): Terminated {rc=256} 13:01:20.355558 --- ParallelTerminationStrategy: PID 7994 died... 13:01:20.375179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7994): Terminated: ok {rc=0} 13:01:20.422402 --- ParallelTerminationStrategy: PID 7997 died... 13:01:20.442084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7997): Terminated: ok {rc=0} 13:01:20.489262 --- ParallelTerminationStrategy: PID 8000 died... 13:01:20.508869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8000): Terminated: ok {rc=0} 13:01:20.598662 bus /gobi_4: Setting Powered False 13:01:21.699723 bus /gobi_4: Setting Powered False 13:01:22.816705 bus /gobi_1: Setting Powered False 13:01:23.916163 bus /gobi_1: Setting Powered False 13:01:25.033129 bus /gobi_0: Setting Powered False 13:01:26.131919 bus /gobi_0: Setting Powered False 13:01:27.249797 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 13:01:28.350878 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:28.362257 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:01:28.399484 tst ping.py: using LAC 21634 13:01:28.519514 tst ping.py: using RAC 214 13:01:28.639839 tst ping.py: using CellId 21634 13:01:28.759307 tst ping.py: using BVCI 21635 13:01:28.868165 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:28.879011 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:28.889726 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:28.900388 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:28.910992 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:28.921478 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:28.932118 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:28.942736 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:01:29.056489 tst ping.py:19: start network... 13:01:29.258969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:01:29.728025 run create_hlr_db(pid=8002): Launched 13:01:29.853213 bus /gobi_6: Setting Powered False 13:01:30.930827 run create_hlr_db(pid=8002): Terminated: ok {rc=0} 13:01:31.382471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8004): Launched 13:01:31.725688 run osmo-hlr_10.42.42.2(pid=8005): Launched 13:01:31.906732 run osmo-stp_10.42.42.5: Starting osmo-stp 13:01:32.555146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8007): Launched 13:01:32.860388 run osmo-stp_10.42.42.5(pid=8008): Launched 13:01:32.975967 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:01:33.499115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8010): Launched 13:01:33.614388 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:01:33.869610 run patchelf(pid=8011): Launched 13:01:34.037547 run osmo-stp_10.42.42.5(pid=8008): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8008)] 13:01:34.166196 run osmo-stp_10.42.42.5(pid=8008): stdout: | (launched: 2022-12-09_13:01:32.804234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:34.296030 run osmo-stp_10.42.42.5(pid=8008): stderr: | 20221209130132975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130132975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130132975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130132976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130132976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130132976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130132976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:34.426273 run osmo-stp_10.42.42.5(pid=8008): stdout: | (launched: 2022-12-09_13:01:32.804234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:34.550131 run osmo-stp_10.42.42.5(pid=8008): stderr: | 20221209130132975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130132975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130132975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130132976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130132976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130132976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130132976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:34.697194 run patchelf(pid=8011): Terminating (SIGINT) 13:01:34.866593 run patchelf(pid=8011): Terminated: ok {rc=0} 13:01:34.988691 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8008): Process ended prematurely: osmo-stp_10.42.42.5(pid=8008) [trial-2360↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8008)] [trial-2360↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 13:01:34.997728 tst ping.py:22: Test FAILED (6.6 sec) 13:01:35.024630 run osmo-hlr_10.42.42.2(pid=8005): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8005)] 13:01:35.072839 run osmo-hlr_10.42.42.2(pid=8005): stdout: | (launched: 2022-12-09_13:01:31.664347) 13:01:35.122813 run osmo-hlr_10.42.42.2(pid=8005): stderr: | 20221209130132037 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130132037 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130132037 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130132037 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130132037 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130132037 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130132060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130132082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130132083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130132083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:01:35.173442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8004): Terminating (SIGTERM) 13:01:35.213961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8007): Terminating (SIGTERM) 13:01:35.254607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8010): Terminating (SIGTERM) 13:01:35.295431 --- ParallelTerminationStrategy: PID 8004 died... 13:01:35.314829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8004): Terminated: ok {rc=0} 13:01:35.359365 --- ParallelTerminationStrategy: PID 8007 died... 13:01:35.378278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8007): Terminated: ok {rc=0} 13:01:35.423514 --- ParallelTerminationStrategy: PID 8010 died... 13:01:35.442451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8010): Terminated: ok {rc=0} 13:01:35.529487 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:01:36.616921 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:36.628640 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:01:36.666822 tst ping_idle_ping.py: using LAC 21635 13:01:36.788472 tst ping_idle_ping.py: using RAC 215 13:01:36.909142 tst ping_idle_ping.py: using CellId 21635 13:01:37.038233 tst ping_idle_ping.py: using BVCI 21636 13:01:37.156343 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:37.167978 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:37.179242 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:37.191358 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:37.202830 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:37.215569 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:37.227880 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:37.239896 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:01:37.356468 tst ping_idle_ping.py:24: start network... 13:01:37.560133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:01:38.034053 run create_hlr_db(pid=8012): Launched 13:01:38.160759 bus /gobi_6: Setting Powered False 13:01:39.222218 run create_hlr_db(pid=8012): Terminated: ok {rc=0} 13:01:39.670310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8014): Launched 13:01:39.996556 run osmo-hlr_10.42.42.2(pid=8015): Launched 13:01:40.120567 run osmo-stp_10.42.42.5: Starting osmo-stp 13:01:40.682041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8017): Launched 13:01:41.005268 run osmo-stp_10.42.42.5(pid=8018): Launched 13:01:41.127652 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:01:41.687359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8020): Launched 13:01:41.812541 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:01:42.085602 run patchelf(pid=8021): Launched 13:01:42.265688 run osmo-stp_10.42.42.5(pid=8018): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8018)] 13:01:42.403098 run osmo-stp_10.42.42.5(pid=8018): stdout: | (launched: 2022-12-09_13:01:40.945853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:42.542560 run osmo-stp_10.42.42.5(pid=8018): stderr: | 20221209130141136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130141136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130141136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130141137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130141137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130141137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130141137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:42.681533 run osmo-stp_10.42.42.5(pid=8018): stdout: | (launched: 2022-12-09_13:01:40.945853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:42.814666 run osmo-stp_10.42.42.5(pid=8018): stderr: | 20221209130141136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130141136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130141136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130141137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130141137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130141137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130141137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:42.971981 run patchelf(pid=8021): Terminating (SIGINT) 13:01:43.152388 run patchelf(pid=8021): Terminated: ok {rc=0} 13:01:43.282522 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8018): Process ended prematurely: osmo-stp_10.42.42.5(pid=8018) [trial-2360↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8018)] [trial-2360↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 13:01:43.292186 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:01:43.321102 run osmo-hlr_10.42.42.2(pid=8015): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8015)] 13:01:43.372014 run osmo-hlr_10.42.42.2(pid=8015): stdout: | (launched: 2022-12-09_13:01:39.936485) 13:01:43.424502 run osmo-hlr_10.42.42.2(pid=8015): stderr: | 20221209130140136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130140136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130140136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130140136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130140136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130140136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130140148 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130140156 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130140156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130140157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:01:43.477874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8014): Terminating (SIGTERM) 13:01:43.520566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8017): Terminating (SIGTERM) 13:01:43.563095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8020): Terminating (SIGTERM) 13:01:43.605891 --- ParallelTerminationStrategy: PID 8014 died... 13:01:43.626205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8014): Terminated: ok {rc=0} 13:01:43.673674 --- ParallelTerminationStrategy: PID 8017 died... 13:01:43.693581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8017): Terminated: ok {rc=0} 13:01:43.740749 --- ParallelTerminationStrategy: PID 8020 died... 13:01:43.760636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8020): Terminated: ok {rc=0} 13:01:43.849177 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:01:45.153907 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:01:45.160856 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:01:45.181682 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:01:45.220291 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:01:45.306927 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:01:45.327587 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:01:45.365966 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:01:45.975548 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:01:46.033436 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:46.045784 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:01:46.106819 tst cs_paging_gprs_active.py: using LAC 21636 13:01:46.229801 tst cs_paging_gprs_active.py: using RAC 216 13:01:46.366702 tst cs_paging_gprs_active.py: using CellId 21636 13:01:46.490191 tst cs_paging_gprs_active.py: using BVCI 21637 13:01:46.651721 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:46.668311 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:46.680202 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:46.691406 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:46.702816 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:46.714402 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:46.726091 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:46.738367 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:46.749881 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:01:46.886419 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:01:47.019816 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:01:47.247903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:01:47.583434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8026): Launched 13:01:47.869415 run iperf3-srv_10.42.42.10(pid=8027): Launched 13:01:47.992196 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:01:48.214644 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:01:48.545706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8028): Launched 13:01:48.831118 run iperf3-srv_10.42.42.10(pid=8029): Launched 13:01:48.954450 tst cs_paging_gprs_active.py:38: start network... 13:01:49.175710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:01:49.685745 run create_hlr_db(pid=8030): Launched 13:01:49.810656 bus /gobi_6: Setting Powered False 13:01:50.875158 run create_hlr_db(pid=8030): Terminated: ok {rc=0} 13:01:51.314028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8032): Launched 13:01:51.624399 run osmo-hlr_10.42.42.2(pid=8033): Launched 13:01:51.742653 run osmo-stp_10.42.42.5: Starting osmo-stp 13:01:52.287885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8035): Launched 13:01:52.596546 run osmo-stp_10.42.42.5(pid=8036): Launched 13:01:52.714424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:01:53.245127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8038): Launched 13:01:53.362673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:01:53.624342 run patchelf(pid=8039): Launched 13:01:53.795369 run osmo-stp_10.42.42.5(pid=8036): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8036)] 13:01:53.925856 run osmo-stp_10.42.42.5(pid=8036): stdout: | (launched: 2022-12-09_13:01:52.539790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:54.058239 run osmo-stp_10.42.42.5(pid=8036): stderr: | 20221209130152711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130152712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130152712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130152712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130152713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130152713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130152713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:54.190384 run osmo-stp_10.42.42.5(pid=8036): stdout: | (launched: 2022-12-09_13:01:52.539790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:54.316781 run osmo-stp_10.42.42.5(pid=8036): stderr: | 20221209130152711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130152712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130152712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130152712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130152713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130152713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130152713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:54.466561 run patchelf(pid=8039): Terminating (SIGINT) 13:01:54.638259 run patchelf(pid=8039): Terminated: ok {rc=0} 13:01:54.762748 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8036): Process ended prematurely: osmo-stp_10.42.42.5(pid=8036) [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8036)] [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:01:54.772111 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:01:54.799205 run osmo-hlr_10.42.42.2(pid=8033): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8033)] 13:01:54.846923 run osmo-hlr_10.42.42.2(pid=8033): stdout: | (launched: 2022-12-09_13:01:51.567127) 13:01:54.896422 run osmo-hlr_10.42.42.2(pid=8033): stderr: | 20221209130151746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130151746 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130151746 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130151746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130151746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130151746 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130151759 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130151768 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130151768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130151768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:01:54.946278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8026): Terminating (SIGTERM) 13:01:54.986090 run iperf3-srv_10.42.42.10(pid=8027): Terminating (SIGTERM) 13:01:55.025876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8028): Terminating (SIGTERM) 13:01:55.065615 run iperf3-srv_10.42.42.10(pid=8029): Terminating (SIGTERM) 13:01:55.105208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8032): Terminating (SIGTERM) 13:01:55.145525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8035): Terminating (SIGTERM) 13:01:55.185113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8038): Terminating (SIGTERM) 13:01:55.224739 --- ParallelTerminationStrategy: PID 8026 died... 13:01:55.243784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8026): Terminated: ok {rc=0} 13:01:55.287774 --- ParallelTerminationStrategy: PID 8027 died... 13:01:55.306421 run iperf3-srv_10.42.42.10(pid=8027): Terminated {rc=256} 13:01:55.350098 --- ParallelTerminationStrategy: PID 8028 died... 13:01:55.368578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8028): Terminated: ok {rc=0} 13:01:55.412639 --- ParallelTerminationStrategy: PID 8029 died... 13:01:55.431386 run iperf3-srv_10.42.42.10(pid=8029): Terminated {rc=256} 13:01:55.475129 --- ParallelTerminationStrategy: PID 8032 died... 13:01:55.493735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8032): Terminated: ok {rc=0} 13:01:55.537573 --- ParallelTerminationStrategy: PID 8035 died... 13:01:55.556150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8035): Terminated: ok {rc=0} 13:01:55.599855 --- ParallelTerminationStrategy: PID 8038 died... 13:01:55.618503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8038): Terminated: ok {rc=0} 13:01:55.703839 bus /gobi_0: Setting Powered False 13:01:56.804727 bus /gobi_0: Setting Powered False 13:01:57.919396 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:01:59.069673 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:59.081882 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:01:59.143383 tst iperf3.py: using LAC 21637 13:01:59.273849 tst iperf3.py: using RAC 217 13:01:59.403650 tst iperf3.py: using CellId 21637 13:01:59.533754 tst iperf3.py: using BVCI 21638 13:01:59.645894 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:59.657056 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:59.667766 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:59.678702 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:59.689519 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:59.700314 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:59.711338 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:59.721957 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:59.732739 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:01:59.852554 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:02:00.074548 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:02:00.403847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8040): Launched 13:02:00.690552 run iperf3-srv_10.42.42.10(pid=8041): Launched 13:02:00.816026 tst iperf3.py:8: start network... 13:02:01.058926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:02:01.579749 run create_hlr_db(pid=8042): Launched 13:02:01.736809 bus /gobi_6: Setting Powered False 13:02:02.797979 run create_hlr_db(pid=8042): Terminated: ok {rc=0} 13:02:03.226496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8044): Launched 13:02:03.537263 run osmo-hlr_10.42.42.2(pid=8045): Launched 13:02:03.654272 run osmo-stp_10.42.42.5: Starting osmo-stp 13:02:04.199322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8047): Launched 13:02:04.509375 run osmo-stp_10.42.42.5(pid=8048): Launched 13:02:04.626691 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:02:05.175477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8050): Launched 13:02:05.293484 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:02:05.554740 run patchelf(pid=8051): Launched 13:02:05.727034 run osmo-stp_10.42.42.5(pid=8048): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8048)] 13:02:05.857642 run osmo-stp_10.42.42.5(pid=8048): stdout: | (launched: 2022-12-09_13:02:04.452060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:05.989414 run osmo-stp_10.42.42.5(pid=8048): stderr: | 20221209130204627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130204627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130204628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130204628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130204628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130204629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130204629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:06.121837 run osmo-stp_10.42.42.5(pid=8048): stdout: | (launched: 2022-12-09_13:02:04.452060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:06.247987 run osmo-stp_10.42.42.5(pid=8048): stderr: | 20221209130204627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130204627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130204628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130204628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130204628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130204629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130204629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:06.397808 run patchelf(pid=8051): Terminating (SIGINT) 13:02:06.569533 run patchelf(pid=8051): Terminated: ok {rc=0} 13:02:06.692770 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8048): Process ended prematurely: osmo-stp_10.42.42.5(pid=8048) [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8048)] [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 13:02:06.702376 tst iperf3.py:8: Test FAILED (7.7 sec) 13:02:06.729566 run osmo-hlr_10.42.42.2(pid=8045): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8045)] 13:02:06.777330 run osmo-hlr_10.42.42.2(pid=8045): stdout: | (launched: 2022-12-09_13:02:03.478716) 13:02:06.826690 run osmo-hlr_10.42.42.2(pid=8045): stderr: | 20221209130203657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130203657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130203657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130203657 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130203657 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130203657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130203669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130203678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130203679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130203679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:02:06.876408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8040): Terminating (SIGTERM) 13:02:06.916025 run iperf3-srv_10.42.42.10(pid=8041): Terminating (SIGTERM) 13:02:06.955572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8044): Terminating (SIGTERM) 13:02:06.995291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8047): Terminating (SIGTERM) 13:02:07.035080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8050): Terminating (SIGTERM) 13:02:07.074923 --- ParallelTerminationStrategy: PID 8040 died... 13:02:07.094209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8040): Terminated: ok {rc=0} 13:02:07.138433 --- ParallelTerminationStrategy: PID 8041 died... 13:02:07.157051 run iperf3-srv_10.42.42.10(pid=8041): Terminated {rc=256} 13:02:07.201115 --- ParallelTerminationStrategy: PID 8044 died... 13:02:07.219774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8044): Terminated: ok {rc=0} 13:02:07.263670 --- ParallelTerminationStrategy: PID 8047 died... 13:02:07.282332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8047): Terminated: ok {rc=0} 13:02:07.326348 --- ParallelTerminationStrategy: PID 8050 died... 13:02:07.345242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8050): Terminated: ok {rc=0} 13:02:07.431857 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:02:08.580137 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:08.591741 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:02:08.648396 tst iperf3m4.py: using LAC 21638 13:02:08.769693 tst iperf3m4.py: using RAC 218 13:02:08.889116 tst iperf3m4.py: using CellId 21638 13:02:09.007537 tst iperf3m4.py: using BVCI 21639 13:02:09.119337 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:09.130287 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:09.141065 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:09.151693 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:09.162727 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:09.173315 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:09.184106 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:09.194801 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:09.205528 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:02:09.327212 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:02:09.448083 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:02:09.570083 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:02:09.687063 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:02:09.893560 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:02:10.202724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8052): Launched 13:02:10.471329 run iperf3-srv_10.42.42.10(pid=8053): Launched 13:02:10.587405 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:02:10.793205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:02:11.102319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8054): Launched 13:02:11.372368 run iperf3-srv_10.42.42.10(pid=8055): Launched 13:02:11.487966 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:02:11.694039 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:02:12.004437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8056): Launched 13:02:12.273574 run iperf3-srv_10.42.42.10(pid=8057): Launched 13:02:12.389178 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:02:12.594924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:02:12.905055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8058): Launched 13:02:13.173181 run iperf3-srv_10.42.42.10(pid=8059): Launched 13:02:13.288454 tst iperf3m4.py:8: start network... 13:02:13.493868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:02:13.972814 run create_hlr_db(pid=8060): Launched 13:02:14.098262 bus /gobi_6: Setting Powered False 13:02:15.159037 run create_hlr_db(pid=8060): Terminated: ok {rc=0} 13:02:15.607737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8062): Launched 13:02:15.953665 run osmo-hlr_10.42.42.2(pid=8063): Launched 13:02:16.229207 run osmo-stp_10.42.42.5: Starting osmo-stp 13:02:16.880677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8065): Launched 13:02:17.211487 run osmo-stp_10.42.42.5(pid=8066): Launched 13:02:17.338257 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:02:17.873866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8068): Launched 13:02:17.991781 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:02:18.253283 run patchelf(pid=8069): Launched 13:02:18.425141 run osmo-stp_10.42.42.5(pid=8066): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8066)] 13:02:18.555902 run osmo-stp_10.42.42.5(pid=8066): stdout: | (launched: 2022-12-09_13:02:17.152081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:18.687986 run osmo-stp_10.42.42.5(pid=8066): stderr: | 20221209130217325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130217326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130217326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130217326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130217327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130217327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130217327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:18.819859 run osmo-stp_10.42.42.5(pid=8066): stdout: | (launched: 2022-12-09_13:02:17.152081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:18.946609 run osmo-stp_10.42.42.5(pid=8066): stderr: | 20221209130217325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130217326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130217326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130217326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130217327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130217327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130217327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:19.096522 run patchelf(pid=8069): Terminating (SIGINT) 13:02:19.269416 run patchelf(pid=8069): Terminated: ok {rc=0} 13:02:19.393705 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8066): Process ended prematurely: osmo-stp_10.42.42.5(pid=8066) [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8066)] [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:02:19.403096 tst iperf3m4.py:8: Test FAILED (10.9 sec) 13:02:19.430705 run osmo-hlr_10.42.42.2(pid=8063): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8063)] 13:02:19.479178 run osmo-hlr_10.42.42.2(pid=8063): stdout: | (launched: 2022-12-09_13:02:15.888251) 13:02:19.529447 run osmo-hlr_10.42.42.2(pid=8063): stderr: | 20221209130216171 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130216171 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130216171 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130216171 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130216172 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130216172 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130216191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130216199 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130216200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130216200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:02:19.580196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8052): Terminating (SIGTERM) 13:02:19.621247 run iperf3-srv_10.42.42.10(pid=8053): Terminating (SIGTERM) 13:02:19.661730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8054): Terminating (SIGTERM) 13:02:19.702311 run iperf3-srv_10.42.42.10(pid=8055): Terminating (SIGTERM) 13:02:19.742552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8056): Terminating (SIGTERM) 13:02:19.783012 run iperf3-srv_10.42.42.10(pid=8057): Terminating (SIGTERM) 13:02:19.823284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8058): Terminating (SIGTERM) 13:02:19.863655 run iperf3-srv_10.42.42.10(pid=8059): Terminating (SIGTERM) 13:02:19.903829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8062): Terminating (SIGTERM) 13:02:19.944725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8065): Terminating (SIGTERM) 13:02:19.984917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8068): Terminating (SIGTERM) 13:02:20.025381 --- ParallelTerminationStrategy: PID 8052 died... 13:02:20.044678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8052): Terminated: ok {rc=0} 13:02:20.089758 --- ParallelTerminationStrategy: PID 8053 died... 13:02:20.108464 run iperf3-srv_10.42.42.10(pid=8053): Terminated {rc=256} 13:02:20.152885 --- ParallelTerminationStrategy: PID 8054 died... 13:02:20.172153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8054): Terminated: ok {rc=0} 13:02:20.217110 --- ParallelTerminationStrategy: PID 8055 died... 13:02:20.235926 run iperf3-srv_10.42.42.10(pid=8055): Terminated {rc=256} 13:02:20.279903 --- ParallelTerminationStrategy: PID 8056 died... 13:02:20.298623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8056): Terminated: ok {rc=0} 13:02:20.342917 --- ParallelTerminationStrategy: PID 8057 died... 13:02:20.361625 run iperf3-srv_10.42.42.10(pid=8057): Terminated {rc=256} 13:02:20.405719 --- ParallelTerminationStrategy: PID 8058 died... 13:02:20.424410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8058): Terminated: ok {rc=0} 13:02:20.469464 --- ParallelTerminationStrategy: PID 8059 died... 13:02:20.488218 run iperf3-srv_10.42.42.10(pid=8059): Terminated {rc=256} 13:02:20.532237 --- ParallelTerminationStrategy: PID 8062 died... 13:02:20.551511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8062): Terminated: ok {rc=0} 13:02:20.595832 --- ParallelTerminationStrategy: PID 8065 died... 13:02:20.614762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8065): Terminated: ok {rc=0} 13:02:20.658951 --- ParallelTerminationStrategy: PID 8068 died... 13:02:20.678271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8068): Terminated: ok {rc=0} 13:02:20.764713 bus /gobi_4: Setting Powered False 13:02:21.866488 bus /gobi_4: Setting Powered False 13:02:22.984530 bus /gobi_1: Setting Powered False 13:02:24.083596 bus /gobi_1: Setting Powered False 13:02:25.199901 bus /gobi_0: Setting Powered False 13:02:26.300262 bus /gobi_0: Setting Powered False 13:02:27.417863 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:02:28.522154 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:28.533876 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:02:28.590760 tst ping.py: using LAC 21639 13:02:28.714670 tst ping.py: using RAC 219 13:02:28.833461 tst ping.py: using CellId 21639 13:02:28.953000 tst ping.py: using BVCI 21640 13:02:29.062927 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:29.073972 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:29.084678 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:29.095420 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:29.106071 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:29.116575 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:29.127436 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:29.138171 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:02:29.254244 tst ping.py:19: start network... 13:02:29.455726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:02:29.924424 run create_hlr_db(pid=8070): Launched 13:02:30.047331 bus /gobi_6: Setting Powered False 13:02:31.110005 run create_hlr_db(pid=8070): Terminated: ok {rc=0} 13:02:31.574175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8072): Launched 13:02:31.915134 run osmo-hlr_10.42.42.2(pid=8073): Launched 13:02:32.167922 run osmo-stp_10.42.42.5: Starting osmo-stp 13:02:32.724325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8075): Launched 13:02:33.026636 run osmo-stp_10.42.42.5(pid=8076): Launched 13:02:33.144084 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:02:33.667421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8078): Launched 13:02:33.783700 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:02:34.039440 run patchelf(pid=8079): Launched 13:02:34.209460 run osmo-stp_10.42.42.5(pid=8076): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8076)] 13:02:34.337975 run osmo-stp_10.42.42.5(pid=8076): stdout: | (launched: 2022-12-09_13:02:32.970689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:34.468013 run osmo-stp_10.42.42.5(pid=8076): stderr: | 20221209130233143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130233143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130233143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130233144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130233144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130233144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130233144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:34.598025 run osmo-stp_10.42.42.5(pid=8076): stdout: | (launched: 2022-12-09_13:02:32.970689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:34.722169 run osmo-stp_10.42.42.5(pid=8076): stderr: | 20221209130233143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130233143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130233143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130233144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130233144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130233144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130233144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:34.869621 run patchelf(pid=8079): Terminating (SIGINT) 13:02:35.038988 run patchelf(pid=8079): Terminated: ok {rc=0} 13:02:35.160927 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8076): Process ended prematurely: osmo-stp_10.42.42.5(pid=8076) [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8076)] [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 13:02:35.170023 tst ping.py:22: Test FAILED (6.6 sec) 13:02:35.196817 run osmo-hlr_10.42.42.2(pid=8073): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8073)] 13:02:35.245123 run osmo-hlr_10.42.42.2(pid=8073): stdout: | (launched: 2022-12-09_13:02:31.855534) 13:02:35.295063 run osmo-hlr_10.42.42.2(pid=8073): stderr: | 20221209130232055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130232055 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130232055 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130232055 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130232055 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130232055 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130232073 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130232090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130232091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130232091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:02:35.345988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8072): Terminating (SIGTERM) 13:02:35.386546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8075): Terminating (SIGTERM) 13:02:35.427207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8078): Terminating (SIGTERM) 13:02:35.467961 --- ParallelTerminationStrategy: PID 8072 died... 13:02:35.487389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8072): Terminated: ok {rc=0} 13:02:35.532292 --- ParallelTerminationStrategy: PID 8075 died... 13:02:35.551641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8075): Terminated: ok {rc=0} 13:02:35.596139 --- ParallelTerminationStrategy: PID 8078 died... 13:02:35.615046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8078): Terminated: ok {rc=0} 13:02:35.701508 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:02:36.791321 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:36.803088 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:02:36.861733 tst ping_idle_ping.py: using LAC 21640 13:02:36.982248 tst ping_idle_ping.py: using RAC 220 13:02:37.102304 tst ping_idle_ping.py: using CellId 21640 13:02:37.226800 tst ping_idle_ping.py: using BVCI 21641 13:02:37.339115 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:37.350209 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:37.360891 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:37.372121 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:37.382816 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:37.393505 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:37.404361 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:37.415327 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:02:37.530663 tst ping_idle_ping.py:24: start network... 13:02:37.734142 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:02:38.208921 run create_hlr_db(pid=8081): Launched 13:02:38.332505 bus /gobi_6: Setting Powered False 13:02:39.392384 run create_hlr_db(pid=8081): Terminated: ok {rc=0} 13:02:39.837130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8083): Launched 13:02:40.162635 run osmo-hlr_10.42.42.2(pid=8084): Launched 13:02:40.286742 run osmo-stp_10.42.42.5: Starting osmo-stp 13:02:40.847089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8086): Launched 13:02:41.173651 run osmo-stp_10.42.42.5(pid=8087): Launched 13:02:41.298892 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:02:41.859893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8089): Launched 13:02:41.984004 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:02:42.257803 run patchelf(pid=8090): Launched 13:02:42.438859 run osmo-stp_10.42.42.5(pid=8087): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8087)] 13:02:42.577374 run osmo-stp_10.42.42.5(pid=8087): stdout: | (launched: 2022-12-09_13:02:41.113925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:42.716914 run osmo-stp_10.42.42.5(pid=8087): stderr: | 20221209130241306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130241306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130241307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130241307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130241308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130241308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130241308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:42.855982 run osmo-stp_10.42.42.5(pid=8087): stdout: | (launched: 2022-12-09_13:02:41.113925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:42.989201 run osmo-stp_10.42.42.5(pid=8087): stderr: | 20221209130241306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130241306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130241307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130241307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130241308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130241308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130241308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:43.146958 run patchelf(pid=8090): Terminating (SIGINT) 13:02:43.328189 run patchelf(pid=8090): Terminated: ok {rc=0} 13:02:43.458849 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8087): Process ended prematurely: osmo-stp_10.42.42.5(pid=8087) [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8087)] [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:02:43.468741 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:02:43.497891 run osmo-hlr_10.42.42.2(pid=8084): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8084)] 13:02:43.549739 run osmo-hlr_10.42.42.2(pid=8084): stdout: | (launched: 2022-12-09_13:02:40.102791) 13:02:43.603347 run osmo-hlr_10.42.42.2(pid=8084): stderr: | 20221209130240301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130240301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130240301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130240301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130240301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130240301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130240313 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130240321 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130240322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130240322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:02:43.656829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8083): Terminating (SIGTERM) 13:02:43.699901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8086): Terminating (SIGTERM) 13:02:43.743117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8089): Terminating (SIGTERM) 13:02:43.786426 --- ParallelTerminationStrategy: PID 8083 died... 13:02:43.806883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8083): Terminated: ok {rc=0} 13:02:43.854362 --- ParallelTerminationStrategy: PID 8086 died... 13:02:43.874277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8086): Terminated: ok {rc=0} 13:02:43.921599 --- ParallelTerminationStrategy: PID 8089 died... 13:02:43.941560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8089): Terminated: ok {rc=0} 13:02:44.030970 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:02:45.334008 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:02:45.340412 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:02:45.362044 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:02:45.402545 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:02:45.491639 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:02:45.512806 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:02:45.552473 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:02:46.179628 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:02:46.245734 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:46.260592 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:02:46.327212 tst cs_paging_gprs_active.py: using LAC 21641 13:02:46.457360 tst cs_paging_gprs_active.py: using RAC 221 13:02:46.611457 tst cs_paging_gprs_active.py: using CellId 21641 13:02:46.737366 tst cs_paging_gprs_active.py: using BVCI 21642 13:02:46.852894 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:46.864476 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:46.875883 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:46.887662 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:46.900143 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:46.911465 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:46.923398 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:46.935215 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:46.947291 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:02:47.066597 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:02:47.187543 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:02:47.397611 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:02:47.708941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8094): Launched 13:02:47.979294 run iperf3-srv_10.42.42.10(pid=8095): Launched 13:02:48.095491 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:02:48.302904 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:02:48.614288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8096): Launched 13:02:48.884552 run iperf3-srv_10.42.42.10(pid=8097): Launched 13:02:49.001094 tst cs_paging_gprs_active.py:38: start network... 13:02:49.208623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:02:49.688399 run create_hlr_db(pid=8098): Launched 13:02:49.815871 bus /gobi_6: Setting Powered False 13:02:50.881266 run create_hlr_db(pid=8098): Terminated: ok {rc=0} 13:02:51.322050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8100): Launched 13:02:51.632256 run osmo-hlr_10.42.42.2(pid=8101): Launched 13:02:51.750246 run osmo-stp_10.42.42.5: Starting osmo-stp 13:02:52.290372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8103): Launched 13:02:52.600637 run osmo-stp_10.42.42.5(pid=8104): Launched 13:02:52.719369 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:02:53.255270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8106): Launched 13:02:53.373905 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:02:53.636080 run patchelf(pid=8107): Launched 13:02:53.808370 run osmo-stp_10.42.42.5(pid=8104): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8104)] 13:02:53.940310 run osmo-stp_10.42.42.5(pid=8104): stdout: | (launched: 2022-12-09_13:02:52.543574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:54.073487 run osmo-stp_10.42.42.5(pid=8104): stderr: | 20221209130252716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130252716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130252716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130252717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130252717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130252717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130252717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:54.206915 run osmo-stp_10.42.42.5(pid=8104): stdout: | (launched: 2022-12-09_13:02:52.543574) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:54.334004 run osmo-stp_10.42.42.5(pid=8104): stderr: | 20221209130252716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130252716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130252716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130252717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130252717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130252717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130252717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:54.484624 run patchelf(pid=8107): Terminating (SIGINT) 13:02:54.657923 run patchelf(pid=8107): Terminated: ok {rc=0} 13:02:54.782452 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8104): Process ended prematurely: osmo-stp_10.42.42.5(pid=8104) [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8104)] [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:02:54.791928 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 13:02:54.819075 run osmo-hlr_10.42.42.2(pid=8101): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8101)] 13:02:54.867117 run osmo-hlr_10.42.42.2(pid=8101): stdout: | (launched: 2022-12-09_13:02:51.574928) 13:02:54.917221 run osmo-hlr_10.42.42.2(pid=8101): stderr: | 20221209130251753 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130251753 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130251753 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130251753 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130251753 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130251754 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130251766 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130251776 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130251777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130251777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:02:54.967281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8094): Terminating (SIGTERM) 13:02:55.007657 run iperf3-srv_10.42.42.10(pid=8095): Terminating (SIGTERM) 13:02:55.048034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8096): Terminating (SIGTERM) 13:02:55.088284 run iperf3-srv_10.42.42.10(pid=8097): Terminating (SIGTERM) 13:02:55.128450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8100): Terminating (SIGTERM) 13:02:55.168613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8103): Terminating (SIGTERM) 13:02:55.208823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8106): Terminating (SIGTERM) 13:02:55.249275 --- ParallelTerminationStrategy: PID 8094 died... 13:02:55.268364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8094): Terminated: ok {rc=0} 13:02:55.312721 --- ParallelTerminationStrategy: PID 8095 died... 13:02:55.331338 run iperf3-srv_10.42.42.10(pid=8095): Terminated {rc=256} 13:02:55.375303 --- ParallelTerminationStrategy: PID 8096 died... 13:02:55.394282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8096): Terminated: ok {rc=0} 13:02:55.438480 --- ParallelTerminationStrategy: PID 8097 died... 13:02:55.457136 run iperf3-srv_10.42.42.10(pid=8097): Terminated {rc=256} 13:02:55.501197 --- ParallelTerminationStrategy: PID 8100 died... 13:02:55.520030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8100): Terminated: ok {rc=0} 13:02:55.564111 --- ParallelTerminationStrategy: PID 8103 died... 13:02:55.582966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8103): Terminated: ok {rc=0} 13:02:55.627296 --- ParallelTerminationStrategy: PID 8106 died... 13:02:55.646438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8106): Terminated: ok {rc=0} 13:02:55.731287 bus /gobi_0: Setting Powered False 13:02:56.828749 bus /gobi_0: Setting Powered False 13:02:57.945101 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:02:59.093864 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:59.105665 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:02:59.165412 tst iperf3.py: using LAC 21642 13:02:59.288726 tst iperf3.py: using RAC 222 13:02:59.411624 tst iperf3.py: using CellId 21642 13:02:59.534596 tst iperf3.py: using BVCI 21643 13:02:59.655909 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:59.667583 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:59.678888 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:59.690440 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:59.702208 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:59.713743 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:59.725489 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:59.736694 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:59.748280 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:02:59.868427 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:03:00.090815 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:03:00.421358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8108): Launched 13:03:00.708315 run iperf3-srv_10.42.42.10(pid=8109): Launched 13:03:00.832935 tst iperf3.py:8: start network... 13:03:01.082376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:01.584800 run create_hlr_db(pid=8111): Launched 13:03:01.751656 bus /gobi_6: Setting Powered False 13:03:02.812352 run create_hlr_db(pid=8111): Terminated: ok {rc=0} 13:03:03.245716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8113): Launched 13:03:03.554983 run osmo-hlr_10.42.42.2(pid=8114): Launched 13:03:03.675154 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:04.213530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8116): Launched 13:03:04.522185 run osmo-stp_10.42.42.5(pid=8117): Launched 13:03:04.642052 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:03:05.190479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8119): Launched 13:03:05.307976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:03:05.569052 run patchelf(pid=8120): Launched 13:03:05.740392 run osmo-stp_10.42.42.5(pid=8117): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8117)] 13:03:05.871038 run osmo-stp_10.42.42.5(pid=8117): stdout: | (launched: 2022-12-09_13:03:04.465123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:06.003848 run osmo-stp_10.42.42.5(pid=8117): stderr: | 20221209130304640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130304641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130304641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130304641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130304642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130304642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130304642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:06.136127 run osmo-stp_10.42.42.5(pid=8117): stdout: | (launched: 2022-12-09_13:03:04.465123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:06.263247 run osmo-stp_10.42.42.5(pid=8117): stderr: | 20221209130304640 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130304641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130304641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130304641 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130304642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130304642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130304642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:06.413408 run patchelf(pid=8120): Terminating (SIGINT) 13:03:06.585891 run patchelf(pid=8120): Terminated: ok {rc=0} 13:03:06.710119 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8117): Process ended prematurely: osmo-stp_10.42.42.5(pid=8117) [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8117)] [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 13:03:06.719655 tst iperf3.py:8: Test FAILED (7.7 sec) 13:03:06.746895 run osmo-hlr_10.42.42.2(pid=8114): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8114)] 13:03:06.795053 run osmo-hlr_10.42.42.2(pid=8114): stdout: | (launched: 2022-12-09_13:03:03.497910) 13:03:06.845076 run osmo-hlr_10.42.42.2(pid=8114): stderr: | 20221209130303676 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130303676 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130303676 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130303676 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130303677 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130303677 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130303689 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130303697 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130303697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130303697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:03:06.895059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8108): Terminating (SIGTERM) 13:03:06.935358 run iperf3-srv_10.42.42.10(pid=8109): Terminating (SIGTERM) 13:03:06.975488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8113): Terminating (SIGTERM) 13:03:07.015658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8116): Terminating (SIGTERM) 13:03:07.055894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8119): Terminating (SIGTERM) 13:03:07.096152 --- ParallelTerminationStrategy: PID 8108 died... 13:03:07.115477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8108): Terminated: ok {rc=0} 13:03:07.159825 --- ParallelTerminationStrategy: PID 8109 died... 13:03:07.178746 run iperf3-srv_10.42.42.10(pid=8109): Terminated {rc=256} 13:03:07.222765 --- ParallelTerminationStrategy: PID 8113 died... 13:03:07.241657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8113): Terminated: ok {rc=0} 13:03:07.286201 --- ParallelTerminationStrategy: PID 8116 died... 13:03:07.305042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8116): Terminated: ok {rc=0} 13:03:07.349225 --- ParallelTerminationStrategy: PID 8119 died... 13:03:07.367899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8119): Terminated: ok {rc=0} 13:03:07.452061 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:03:08.600117 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:08.611878 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:03:08.669775 tst iperf3m4.py: using LAC 21643 13:03:08.799431 tst iperf3m4.py: using RAC 223 13:03:08.929375 tst iperf3m4.py: using CellId 21643 13:03:09.057918 tst iperf3m4.py: using BVCI 21644 13:03:09.177830 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:09.189512 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:09.200786 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:09.212352 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:09.223848 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:09.235249 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:09.246734 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:09.258112 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:09.269813 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:03:09.390938 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:03:09.510759 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:03:09.629254 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:03:09.748063 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:03:09.970334 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:03:10.301683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8121): Launched 13:03:10.588849 run iperf3-srv_10.42.42.10(pid=8122): Launched 13:03:10.712704 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:03:10.933471 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:03:11.264286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8123): Launched 13:03:11.551390 run iperf3-srv_10.42.42.10(pid=8124): Launched 13:03:11.675282 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:03:11.896014 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:03:12.226689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8125): Launched 13:03:12.515479 run iperf3-srv_10.42.42.10(pid=8126): Launched 13:03:12.639501 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:03:12.860549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:03:13.191865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8127): Launched 13:03:13.478925 run iperf3-srv_10.42.42.10(pid=8128): Launched 13:03:13.604375 tst iperf3m4.py:8: start network... 13:03:13.825304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:14.335130 run create_hlr_db(pid=8129): Launched 13:03:14.460386 bus /gobi_6: Setting Powered False 13:03:15.525630 run create_hlr_db(pid=8129): Terminated: ok {rc=0} 13:03:16.020732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8131): Launched 13:03:16.376497 run osmo-hlr_10.42.42.2(pid=8132): Launched 13:03:16.600860 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:17.249370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8134): Launched 13:03:17.582184 run osmo-stp_10.42.42.5(pid=8135): Launched 13:03:17.709450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:03:18.277541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8137): Launched 13:03:18.403282 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:03:18.682210 run patchelf(pid=8138): Launched 13:03:18.864862 run osmo-stp_10.42.42.5(pid=8135): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8135)] 13:03:19.004531 run osmo-stp_10.42.42.5(pid=8135): stdout: | (launched: 2022-12-09_13:03:17.521533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:19.145623 run osmo-stp_10.42.42.5(pid=8135): stderr: | 20221209130317711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130317711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130317711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130317712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130317712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130317712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130317712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:19.286964 run osmo-stp_10.42.42.5(pid=8135): stdout: | (launched: 2022-12-09_13:03:17.521533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:19.422521 run osmo-stp_10.42.42.5(pid=8135): stderr: | 20221209130317711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130317711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130317711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130317712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130317712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130317712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130317712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:19.583928 run patchelf(pid=8138): Terminating (SIGINT) 13:03:19.768244 run patchelf(pid=8138): Terminated: ok {rc=0} 13:03:19.900540 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8135): Process ended prematurely: osmo-stp_10.42.42.5(pid=8135) [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8135)] [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:03:19.910993 tst iperf3m4.py:8: Test FAILED (11.3 sec) 13:03:19.940758 run osmo-hlr_10.42.42.2(pid=8132): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8132)] 13:03:19.992171 run osmo-hlr_10.42.42.2(pid=8132): stdout: | (launched: 2022-12-09_13:03:16.315784) 13:03:20.045282 run osmo-hlr_10.42.42.2(pid=8132): stderr: | 20221209130316606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130316606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130316606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130316606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130316606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130316606 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130316630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130316642 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130316642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130316642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:03:20.098666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8121): Terminating (SIGTERM) 13:03:20.141579 run iperf3-srv_10.42.42.10(pid=8122): Terminating (SIGTERM) 13:03:20.184191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8123): Terminating (SIGTERM) 13:03:20.226781 run iperf3-srv_10.42.42.10(pid=8124): Terminating (SIGTERM) 13:03:20.269201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8125): Terminating (SIGTERM) 13:03:20.311697 run iperf3-srv_10.42.42.10(pid=8126): Terminating (SIGTERM) 13:03:20.354108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8127): Terminating (SIGTERM) 13:03:20.396459 run iperf3-srv_10.42.42.10(pid=8128): Terminating (SIGTERM) 13:03:20.438844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8131): Terminating (SIGTERM) 13:03:20.481780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8134): Terminating (SIGTERM) 13:03:20.524251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8137): Terminating (SIGTERM) 13:03:20.567554 --- ParallelTerminationStrategy: PID 8121 died... 13:03:20.587666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8121): Terminated: ok {rc=0} 13:03:20.635022 --- ParallelTerminationStrategy: PID 8122 died... 13:03:20.654664 run iperf3-srv_10.42.42.10(pid=8122): Terminated {rc=256} 13:03:20.701406 --- ParallelTerminationStrategy: PID 8123 died... 13:03:20.721101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8123): Terminated: ok {rc=0} 13:03:20.767885 --- ParallelTerminationStrategy: PID 8124 died... 13:03:20.787606 run iperf3-srv_10.42.42.10(pid=8124): Terminated {rc=256} 13:03:20.834862 --- ParallelTerminationStrategy: PID 8125 died... 13:03:20.854601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8125): Terminated: ok {rc=0} 13:03:20.901384 --- ParallelTerminationStrategy: PID 8126 died... 13:03:20.920932 run iperf3-srv_10.42.42.10(pid=8126): Terminated {rc=256} 13:03:20.967602 --- ParallelTerminationStrategy: PID 8127 died... 13:03:20.987268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8127): Terminated: ok {rc=0} 13:03:21.034601 --- ParallelTerminationStrategy: PID 8128 died... 13:03:21.054338 run iperf3-srv_10.42.42.10(pid=8128): Terminated {rc=256} 13:03:21.101161 --- ParallelTerminationStrategy: PID 8131 died... 13:03:21.120772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8131): Terminated: ok {rc=0} 13:03:21.167691 --- ParallelTerminationStrategy: PID 8134 died... 13:03:21.187422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8134): Terminated: ok {rc=0} 13:03:21.234274 --- ParallelTerminationStrategy: PID 8137 died... 13:03:21.254088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8137): Terminated: ok {rc=0} 13:03:21.342980 bus /gobi_4: Setting Powered False 13:03:22.443546 bus /gobi_4: Setting Powered False 13:03:23.561957 bus /gobi_1: Setting Powered False 13:03:24.659704 bus /gobi_1: Setting Powered False 13:03:25.776662 bus /gobi_0: Setting Powered False 13:03:26.876365 bus /gobi_0: Setting Powered False 13:03:27.994225 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:03:29.099686 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:29.111947 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:03:29.171514 tst ping.py: using LAC 21644 13:03:29.299137 tst ping.py: using RAC 224 13:03:29.425184 tst ping.py: using CellId 21644 13:03:29.556718 tst ping.py: using BVCI 21645 13:03:29.676166 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:29.687690 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:29.699007 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:29.710487 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:29.721841 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:29.733165 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:29.745102 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:29.756473 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:03:29.876208 tst ping.py:19: start network... 13:03:30.093420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:30.594446 run create_hlr_db(pid=8139): Launched 13:03:30.718784 bus /gobi_6: Setting Powered False 13:03:31.801443 run create_hlr_db(pid=8139): Terminated: ok {rc=0} 13:03:32.247337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8141): Launched 13:03:32.581868 run osmo-hlr_10.42.42.2(pid=8142): Launched 13:03:32.704791 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:33.266767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8144): Launched 13:03:33.590245 run osmo-stp_10.42.42.5(pid=8145): Launched 13:03:33.714557 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:03:34.271535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8147): Launched 13:03:34.396003 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:03:34.669461 run patchelf(pid=8148): Launched 13:03:34.849396 run osmo-stp_10.42.42.5(pid=8145): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8145)] 13:03:34.986078 run osmo-stp_10.42.42.5(pid=8145): stdout: | (launched: 2022-12-09_13:03:33.530490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:35.124238 run osmo-stp_10.42.42.5(pid=8145): stderr: | 20221209130333722 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130333722 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130333723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130333723 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130333723 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130333723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130333723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:35.262787 run osmo-stp_10.42.42.5(pid=8145): stdout: | (launched: 2022-12-09_13:03:33.530490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:35.395356 run osmo-stp_10.42.42.5(pid=8145): stderr: | 20221209130333722 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130333722 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130333723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130333723 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130333723 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130333723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130333723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:35.552808 run patchelf(pid=8148): Terminating (SIGINT) 13:03:35.733601 run patchelf(pid=8148): Terminated: ok {rc=0} 13:03:35.864236 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8145): Process ended prematurely: osmo-stp_10.42.42.5(pid=8145) [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8145)] [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 13:03:35.873990 tst ping.py:22: Test FAILED (6.8 sec) 13:03:35.902904 run osmo-hlr_10.42.42.2(pid=8142): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8142)] 13:03:35.954230 run osmo-hlr_10.42.42.2(pid=8142): stdout: | (launched: 2022-12-09_13:03:32.522163) 13:03:36.007191 run osmo-hlr_10.42.42.2(pid=8142): stderr: | 20221209130332722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130332722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130332722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130332722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130332722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130332722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130332736 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130332746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130332746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130332746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:03:36.060499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8141): Terminating (SIGTERM) 13:03:36.103536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8144): Terminating (SIGTERM) 13:03:36.146430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8147): Terminating (SIGTERM) 13:03:36.189520 --- ParallelTerminationStrategy: PID 8141 died... 13:03:36.209791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8141): Terminated: ok {rc=0} 13:03:36.257514 --- ParallelTerminationStrategy: PID 8144 died... 13:03:36.277397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8144): Terminated: ok {rc=0} 13:03:36.324558 --- ParallelTerminationStrategy: PID 8147 died... 13:03:36.344495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8147): Terminated: ok {rc=0} 13:03:36.433527 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:03:37.523287 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:37.536032 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:03:37.597417 tst ping_idle_ping.py: using LAC 21645 13:03:37.725605 tst ping_idle_ping.py: using RAC 225 13:03:37.851675 tst ping_idle_ping.py: using CellId 21645 13:03:37.977643 tst ping_idle_ping.py: using BVCI 21646 13:03:38.089745 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:38.100932 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:38.112033 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:38.123683 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:38.135276 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:38.146782 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:38.158359 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:38.169933 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:03:38.287261 tst ping_idle_ping.py:24: start network... 13:03:38.492032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:38.972063 run create_hlr_db(pid=8149): Launched 13:03:39.096903 bus /gobi_6: Setting Powered False 13:03:40.157556 run create_hlr_db(pid=8149): Terminated: ok {rc=0} 13:03:40.601667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8151): Launched 13:03:40.925631 run osmo-hlr_10.42.42.2(pid=8152): Launched 13:03:41.048793 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:41.586045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8154): Launched 13:03:41.890657 run osmo-stp_10.42.42.5(pid=8155): Launched 13:03:42.005479 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:03:42.530600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8157): Launched 13:03:42.646912 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:03:42.903794 run patchelf(pid=8158): Launched 13:03:43.072211 run osmo-stp_10.42.42.5(pid=8155): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8155)] 13:03:43.201449 run osmo-stp_10.42.42.5(pid=8155): stdout: | (launched: 2022-12-09_13:03:41.834263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:43.331845 run osmo-stp_10.42.42.5(pid=8155): stderr: | 20221209130342006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130342006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130342007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130342007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130342007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130342008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130342008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:43.462503 run osmo-stp_10.42.42.5(pid=8155): stdout: | (launched: 2022-12-09_13:03:41.834263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:43.587567 run osmo-stp_10.42.42.5(pid=8155): stderr: | 20221209130342006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130342006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130342007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130342007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130342007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130342008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130342008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:43.735136 run patchelf(pid=8158): Terminating (SIGINT) 13:03:43.905044 run patchelf(pid=8158): Terminated: ok {rc=0} 13:03:44.027554 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8155): Process ended prematurely: osmo-stp_10.42.42.5(pid=8155) [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8155)] [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:03:44.036574 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:03:44.063286 run osmo-hlr_10.42.42.2(pid=8152): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8152)] 13:03:44.111637 run osmo-hlr_10.42.42.2(pid=8152): stdout: | (launched: 2022-12-09_13:03:40.866135) 13:03:44.161240 run osmo-hlr_10.42.42.2(pid=8152): stderr: | 20221209130341066 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130341066 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130341066 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130341066 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130341066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130341066 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130341079 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130341088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130341088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130341088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:03:44.211428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8151): Terminating (SIGTERM) 13:03:44.251700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8154): Terminating (SIGTERM) 13:03:44.292743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8157): Terminating (SIGTERM) 13:03:44.333418 --- ParallelTerminationStrategy: PID 8151 died... 13:03:44.352772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8151): Terminated: ok {rc=0} 13:03:44.397504 --- ParallelTerminationStrategy: PID 8154 died... 13:03:44.416265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8154): Terminated: ok {rc=0} 13:03:44.461230 --- ParallelTerminationStrategy: PID 8157 died... 13:03:44.480064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8157): Terminated: ok {rc=0} 13:03:44.564270 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:03:45.859461 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:03:45.868249 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:03:45.897368 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:03:45.967147 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:03:46.029818 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:03:46.055626 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:03:46.098401 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:03:46.642885 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2360 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:03:46.648916 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:03:46.661161 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:03:46.719559 tst switch_tch_pdch.py: using LAC 21646 13:03:46.882606 tst switch_tch_pdch.py: using RAC 226 13:03:47.036329 tst switch_tch_pdch.py: using CellId 21646 13:03:47.161249 tst switch_tch_pdch.py: using BVCI 21647 13:03:47.294223 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:03:47.307747 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:03:47.320512 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:03:47.332132 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:03:47.344443 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:03:47.356650 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:03:47.369258 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:03:47.381601 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:03:47.498399 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:03:47.617893 tst switch_tch_pdch.py:51: start network... 13:03:47.821478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:48.293157 run create_hlr_db(pid=8162): Launched 13:03:48.419366 bus /gobi_6: Setting Powered False 13:03:49.479896 run create_hlr_db(pid=8162): Terminated: ok {rc=0} 13:03:49.924743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8164): Launched 13:03:50.249067 run osmo-hlr_10.42.42.2(pid=8165): Launched 13:03:50.373867 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:50.934620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8167): Launched 13:03:51.257942 run osmo-stp_10.42.42.5(pid=8168): Launched 13:03:51.381941 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:03:51.941401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8170): Launched 13:03:52.065494 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:03:52.338596 run patchelf(pid=8171): Launched 13:03:52.519833 run osmo-stp_10.42.42.5(pid=8168): ERR: Terminated: ERROR {rc=1} [trial-2360↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8168)] 13:03:52.657579 run osmo-stp_10.42.42.5(pid=8168): stdout: | (launched: 2022-12-09_13:03:51.198639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:52.796233 run osmo-stp_10.42.42.5(pid=8168): stderr: | 20221209130351392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130351392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130351392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130351393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130351393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130351393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130351393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:52.935078 run osmo-stp_10.42.42.5(pid=8168): stdout: | (launched: 2022-12-09_13:03:51.198639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:53.067764 run osmo-stp_10.42.42.5(pid=8168): stderr: | 20221209130351392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130351392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130351392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130351393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130351393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130351393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130351393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:53.225255 run patchelf(pid=8171): Terminating (SIGINT) 13:03:53.405793 run patchelf(pid=8171): Terminated: ok {rc=0} 13:03:53.536249 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8168): Process ended prematurely: osmo-stp_10.42.42.5(pid=8168) [trial-2360↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8168)] [trial-2360↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:03:53.546087 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 13:03:53.574802 run osmo-hlr_10.42.42.2(pid=8165): ERR: Terminated: ERROR {rc=237} [trial-2360↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8165)] 13:03:53.625544 run osmo-hlr_10.42.42.2(pid=8165): stdout: | (launched: 2022-12-09_13:03:50.189461) 13:03:53.678294 run osmo-hlr_10.42.42.2(pid=8165): stderr: | 20221209130350389 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130350389 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130350389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130350389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130350389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130350389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130350401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130350409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130350410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130350410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:03:53.731246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8164): Terminating (SIGTERM) 13:03:53.773456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8167): Terminating (SIGTERM) 13:03:53.815963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8170): Terminating (SIGTERM) 13:03:53.858459 --- ParallelTerminationStrategy: PID 8164 died... 13:03:53.878695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8164): Terminated: ok {rc=0} 13:03:53.925586 --- ParallelTerminationStrategy: PID 8167 died... 13:03:53.945322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8167): Terminated: ok {rc=0} 13:03:53.991889 --- ParallelTerminationStrategy: PID 8170 died... 13:03:54.011645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8170): Terminated: ok {rc=0} 13:03:54.101047 bus /gobi_0: Setting Powered False 13:03:55.201232 bus /gobi_0: Setting Powered False 13:03:56.318458 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:03:57.560244 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:03:57.566484 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:03:57.588715 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:03:57.624541 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:03:57.680240 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:03:57.701693 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:03:57.737403 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:03:58.291184 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2360 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:03:58.296480 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:03:58.307844 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:03:58.365774 tst switch_tch_pdch.py: using LAC 21647 13:03:58.492705 tst switch_tch_pdch.py: using RAC 227 13:03:58.618818 tst switch_tch_pdch.py: using CellId 21647 13:03:58.746270 tst switch_tch_pdch.py: using BVCI 21648 13:03:58.863136 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:03:58.874619 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:03:58.885826 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:03:58.897244 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:03:58.908464 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:03:58.919918 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:03:58.931479 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:03:58.942861 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:03:59.058547 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:03:59.172674 tst switch_tch_pdch.py:51: start network... 13:03:59.375870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:59.820339 run create_hlr_db(pid=8176): Launched 13:03:59.947643 bus /gobi_6: Setting Powered False 13:04:01.023492 run create_hlr_db(pid=8176): Terminated: ok {rc=0} 13:04:01.462545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8178): Launched 13:04:01.784759 run osmo-hlr_10.42.42.2(pid=8179): Launched 13:04:02.039278 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:02.656903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8181): Launched 13:04:02.959628 run osmo-stp_10.42.42.5(pid=8182): Launched 13:04:03.074416 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:04:03.570055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8184): Launched 13:04:03.685656 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:04:03.940928 run patchelf(pid=8185): Launched 13:04:04.108796 run osmo-stp_10.42.42.5(pid=8182): ERR: Terminated: ERROR {rc=1} [trial-2360↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8182)] 13:04:04.236860 run osmo-stp_10.42.42.5(pid=8182): stdout: | (launched: 2022-12-09_13:04:02.903695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:04.366326 run osmo-stp_10.42.42.5(pid=8182): stderr: | 20221209130403073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130403073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130403073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130403074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130403074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130403074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130403074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:04.496619 run osmo-stp_10.42.42.5(pid=8182): stdout: | (launched: 2022-12-09_13:04:02.903695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:04.620814 run osmo-stp_10.42.42.5(pid=8182): stderr: | 20221209130403073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130403073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130403073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130403074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130403074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130403074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130403074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:04.767509 run patchelf(pid=8185): Terminating (SIGINT) 13:04:04.935819 run patchelf(pid=8185): Terminated: ok {rc=0} 13:04:05.057279 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8182): Process ended prematurely: osmo-stp_10.42.42.5(pid=8182) [trial-2360↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8182)] [trial-2360↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:04:05.066078 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 13:04:05.092628 run osmo-hlr_10.42.42.2(pid=8179): ERR: Terminated: ERROR {rc=237} [trial-2360↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8179)] 13:04:05.140696 run osmo-hlr_10.42.42.2(pid=8179): stdout: | (launched: 2022-12-09_13:04:01.727289) 13:04:05.190460 run osmo-hlr_10.42.42.2(pid=8179): stderr: | 20221209130402013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130402013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130402014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130402014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130402014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130402014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130402030 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130402053 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130402055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130402055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:05.240844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8178): Terminating (SIGTERM) 13:04:05.281342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8181): Terminating (SIGTERM) 13:04:05.321546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8184): Terminating (SIGTERM) 13:04:05.361966 --- ParallelTerminationStrategy: PID 8178 died... 13:04:05.381148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8178): Terminated: ok {rc=0} 13:04:05.425860 --- ParallelTerminationStrategy: PID 8181 died... 13:04:05.444531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8181): Terminated: ok {rc=0} 13:04:05.488912 --- ParallelTerminationStrategy: PID 8184 died... 13:04:05.507829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8184): Terminated: ok {rc=0} 13:04:05.595295 bus /gobi_0: Setting Powered False 13:04:06.696243 bus /gobi_0: Setting Powered False 13:04:07.813288 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_sms:trx-b200 --------------------------------------------------------------------- 13:04:09.048424 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:04:09.052309 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 13:04:09.086085 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 13:04:09.093044 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 13:04:09.144827 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 13:04:09.178127 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 13:04:09.185006 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 13:04:09.725743 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 13:04:09.733237 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 13:04:09.745212 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 13:04:09.799064 tst mo_mt_sms.py: using LAC 21648 13:04:09.925040 tst mo_mt_sms.py: using RAC 228 13:04:10.051034 tst mo_mt_sms.py: using CellId 21648 13:04:10.176680 tst mo_mt_sms.py: using BVCI 21649 13:04:10.293655 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 13:04:10.410057 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 13:04:10.523305 tst mo_mt_sms.py:9: start nitb and bts... 13:04:10.727807 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:04:11.348341 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8190): Launched 13:04:11.652847 run osmo-nitb_10.42.42.2(pid=8191): Launched 13:04:11.821856 run osmo-nitb_10.42.42.2(pid=8191): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8191)] 13:04:11.958885 run osmo-nitb_10.42.42.2(pid=8191): stdout: | (launched: 2022-12-09_13:04:11.596900) 13:04:12.097171 run osmo-nitb_10.42.42.2(pid=8191): stderr: | (launched: 2022-12-09_13:04:11.642225) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:04:12.235364 run osmo-nitb_10.42.42.2(pid=8191): stdout: | (launched: 2022-12-09_13:04:11.596900) 13:04:12.367819 run osmo-nitb_10.42.42.2(pid=8191): stderr: | (launched: 2022-12-09_13:04:11.642225) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8191): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8191) [trial-2360↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8191)] 13:04:12.767588 tst osmo-nitb_10.42.42.2(pid=8191): stdout: | (launched: 2022-12-09_13:04:11.596900) 13:04:12.890155 tst osmo-nitb_10.42.42.2(pid=8191): stderr: | (launched: 2022-12-09_13:04:11.642225) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:04:13.034056 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=8191): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8191) [trial-2360↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8191)] [trial-2360↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 13:04:13.042322 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 13:04:13.048884 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8190): Terminating (SIGTERM) 13:04:13.258135 --- ParallelTerminationStrategy: PID 8190 died... 13:04:13.279249 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8190): Terminated: ok {rc=0} 13:04:13.366258 bus /sierra_3: Setting Powered False 13:04:14.468357 bus /sierra_3: Setting Powered False 13:04:15.589898 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 sms:trx-b200 --------------------------------------------------------------------- 13:04:16.801797 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:04:16.809341 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 13:04:16.853093 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 13:04:16.888250 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 13:04:16.966957 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 13:04:17.010670 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 13:04:17.045509 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 13:04:17.571503 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 13:04:17.576723 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:17.587491 tst sms:trx-b200: Using 1 x bts (candidates: 1) 13:04:17.635393 tst mo_mt_sms.py: using LAC 21649 13:04:17.754566 tst mo_mt_sms.py: using RAC 229 13:04:17.871924 tst mo_mt_sms.py: using CellId 21649 13:04:17.989908 tst mo_mt_sms.py: using BVCI 21650 13:04:18.108197 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:18.119505 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:18.130640 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:18.141865 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:18.153273 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:18.164499 tst sms:trx-b200: Using 1 x modem (candidates: 2) 13:04:18.278983 tst sms:trx-b200: Using 1 x modem (candidates: 2) 13:04:18.397498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:18.899411 run create_hlr_db(pid=8195): Launched 13:04:19.023152 bus /sierra_2: Setting Powered False 13:04:20.087184 run create_hlr_db(pid=8195): Terminated: ok {rc=0} 13:04:20.523046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8197): Launched 13:04:20.828379 run osmo-hlr_10.42.42.2(pid=8198): Launched 13:04:20.943134 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:21.468645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8200): Launched 13:04:21.771987 run osmo-stp_10.42.42.5(pid=8201): Launched 13:04:21.886931 run osmo-msc_10.42.42.6: Starting osmo-msc 13:04:22.436344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8203): Launched 13:04:22.741087 run osmo-msc_10.42.42.6(pid=8204): Launched 13:04:22.910125 run osmo-stp_10.42.42.5(pid=8201): ERR: Terminated: ERROR {rc=1} [trial-2360↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8201)] 13:04:23.037370 run osmo-stp_10.42.42.5(pid=8201): stdout: | (launched: 2022-12-09_13:04:21.715691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:23.165620 run osmo-stp_10.42.42.5(pid=8201): stderr: | 20221209130421886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130421886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130421887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130421887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130421887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130421888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130421888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:23.291786 run osmo-stp_10.42.42.5(pid=8201): stdout: | (launched: 2022-12-09_13:04:21.715691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:23.411617 run osmo-stp_10.42.42.5(pid=8201): stderr: | 20221209130421886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130421886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130421887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130421887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130421887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130421888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130421888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:23.555395 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=8201): Process ended prematurely: osmo-stp_10.42.42.5(pid=8201) [trial-2360↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8201)] [trial-2360↪sms:trx-b200↪mo_mt_sms.py:16] 13:04:23.564030 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 13:04:23.590173 run osmo-hlr_10.42.42.2(pid=8198): ERR: Terminated: ERROR {rc=237} [trial-2360↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8198)] 13:04:23.638395 run osmo-hlr_10.42.42.2(pid=8198): stdout: | (launched: 2022-12-09_13:04:20.772003) 13:04:23.688181 run osmo-hlr_10.42.42.2(pid=8198): stderr: | 20221209130420948 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130420948 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130420948 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130420948 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130420948 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130420948 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130420960 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130420970 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130420970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130420970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:23.757822 run osmo-msc_10.42.42.6(pid=8204): ERR: Terminated: ERROR {rc=2} [trial-2360↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8204)] 13:04:23.806039 run osmo-msc_10.42.42.6(pid=8204): stdout: | (launched: 2022-12-09_13:04:22.685283) 13:04:23.855697 run osmo-msc_10.42.42.6(pid=8204): stderr: | 20221209130422957 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130422958 DLGLOBAL DEBUG validating counter group 0x7f8ee8f3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130422958 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130422958 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130422958 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130422958 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130422960 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130422960 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130422960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130422960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:23.905741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8197): Terminating (SIGTERM) 13:04:23.945870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8200): Terminating (SIGTERM) 13:04:23.985924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8203): Terminating (SIGTERM) 13:04:24.026163 --- ParallelTerminationStrategy: PID 8197 died... 13:04:24.045417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8197): Terminated: ok {rc=0} 13:04:24.089765 --- ParallelTerminationStrategy: PID 8200 died... 13:04:24.108410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8200): Terminated: ok {rc=0} 13:04:24.152518 --- ParallelTerminationStrategy: PID 8203 died... 13:04:24.171288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8203): Terminated: ok {rc=0} 13:04:24.257507 bus /sierra_3: Setting Powered False 13:04:25.357852 bus /sierra_3: Setting Powered False 13:04:26.473521 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_ussd:trx-b200 --------------------------------------------------------------------- 13:04:27.704535 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:04:27.709651 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 13:04:27.745359 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 13:04:27.752424 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 13:04:27.788319 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 13:04:27.823174 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 13:04:27.830413 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 13:04:28.353096 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2360 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 13:04:28.359577 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 13:04:28.371997 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 13:04:28.422258 tst assert_extension.py: using LAC 21650 13:04:28.550504 tst assert_extension.py: using RAC 230 13:04:28.675720 tst assert_extension.py: using CellId 21650 13:04:28.800195 tst assert_extension.py: using BVCI 21651 13:04:28.919353 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 13:04:29.031981 tst assert_extension.py:10: start nitb and bts... 13:04:29.234520 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:04:29.854241 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8209): Launched 13:04:30.159047 run osmo-nitb_10.42.42.2(pid=8210): Launched 13:04:30.326383 run osmo-nitb_10.42.42.2(pid=8210): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8210)] 13:04:30.461715 run osmo-nitb_10.42.42.2(pid=8210): stdout: | (launched: 2022-12-09_13:04:30.102850) 13:04:30.598760 run osmo-nitb_10.42.42.2(pid=8210): stderr: | (launched: 2022-12-09_13:04:30.148025) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:04:30.736274 run osmo-nitb_10.42.42.2(pid=8210): stdout: | (launched: 2022-12-09_13:04:30.102850) 13:04:30.868129 run osmo-nitb_10.42.42.2(pid=8210): stderr: | (launched: 2022-12-09_13:04:30.148025) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8210): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8210) [trial-2360↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8210)] 13:04:31.272890 tst osmo-nitb_10.42.42.2(pid=8210): stdout: | (launched: 2022-12-09_13:04:30.102850) 13:04:31.402673 tst osmo-nitb_10.42.42.2(pid=8210): stderr: | (launched: 2022-12-09_13:04:30.148025) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:04:31.551026 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=8210): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8210) [trial-2360↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8210)] [trial-2360↪nitb_ussd:trx-b200↪assert_extension.py:12] 13:04:31.560167 tst assert_extension.py:12: Test FAILED (3.2 sec) 13:04:31.567854 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8209): Terminating (SIGTERM) 13:04:31.779027 --- ParallelTerminationStrategy: PID 8209 died... 13:04:31.800064 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8209): Terminated: ok {rc=0} 13:04:31.893770 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 ussd:trx-b200 --------------------------------------------------------------------- 13:04:33.078121 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:04:33.082665 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 13:04:33.116297 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 13:04:33.143205 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 13:04:33.178055 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 13:04:33.211058 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 13:04:33.237700 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 13:04:33.767742 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2360 ussd:trx-b200 assert_extension.py ---------------------------------------------- 13:04:33.772692 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:33.783331 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 13:04:33.831508 tst assert_extension.py: using LAC 21651 13:04:33.952082 tst assert_extension.py: using RAC 231 13:04:34.073226 tst assert_extension.py: using CellId 21651 13:04:34.191824 tst assert_extension.py: using BVCI 21652 13:04:34.300892 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:34.311538 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:34.322058 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:34.332397 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:34.342830 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:04:34.353539 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 13:04:34.470842 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:34.973062 run create_hlr_db(pid=8214): Launched 13:04:35.098592 bus /sierra_2: Setting Powered False 13:04:36.162272 run create_hlr_db(pid=8214): Terminated: ok {rc=0} 13:04:36.596756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8216): Launched 13:04:36.901638 run osmo-hlr_10.42.42.2(pid=8217): Launched 13:04:37.017665 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:37.546134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8219): Launched 13:04:37.848834 run osmo-stp_10.42.42.5(pid=8220): Launched 13:04:37.964482 run osmo-msc_10.42.42.6: Starting osmo-msc 13:04:38.510811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8222): Launched 13:04:38.814628 run osmo-msc_10.42.42.6(pid=8223): Launched 13:04:38.985484 run osmo-stp_10.42.42.5(pid=8220): ERR: Terminated: ERROR {rc=1} [trial-2360↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8220)] 13:04:39.113189 run osmo-stp_10.42.42.5(pid=8220): stdout: | (launched: 2022-12-09_13:04:37.792657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:39.242152 run osmo-stp_10.42.42.5(pid=8220): stderr: | 20221209130437962 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130437962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130437962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130437963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130437963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130437963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130437963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:39.368296 run osmo-stp_10.42.42.5(pid=8220): stdout: | (launched: 2022-12-09_13:04:37.792657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:39.488565 run osmo-stp_10.42.42.5(pid=8220): stderr: | 20221209130437962 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130437962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130437962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130437963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130437963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130437963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130437963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:39.631923 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=8220): Process ended prematurely: osmo-stp_10.42.42.5(pid=8220) [trial-2360↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8220)] [trial-2360↪ussd:trx-b200↪assert_extension.py:17] 13:04:39.640226 tst assert_extension.py:17: Test FAILED (5.9 sec) 13:04:39.666495 run osmo-hlr_10.42.42.2(pid=8217): ERR: Terminated: ERROR {rc=237} [trial-2360↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8217)] 13:04:39.715124 run osmo-hlr_10.42.42.2(pid=8217): stdout: | (launched: 2022-12-09_13:04:36.845726) 13:04:39.765188 run osmo-hlr_10.42.42.2(pid=8217): stderr: | 20221209130437024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130437024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130437024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130437024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130437024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130437024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130437037 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130437046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130437046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130437046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:39.835079 run osmo-msc_10.42.42.6(pid=8223): ERR: Terminated: ERROR {rc=2} [trial-2360↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8223)] 13:04:39.883335 run osmo-msc_10.42.42.6(pid=8223): stdout: | (launched: 2022-12-09_13:04:38.758832) 13:04:39.933288 run osmo-msc_10.42.42.6(pid=8223): stderr: | 20221209130439031 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130439031 DLGLOBAL DEBUG validating counter group 0x7f667a844c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130439031 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130439032 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130439032 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130439032 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130439035 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130439035 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130439035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130439035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:39.984276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8216): Terminating (SIGTERM) 13:04:40.024355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8219): Terminating (SIGTERM) 13:04:40.064485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8222): Terminating (SIGTERM) 13:04:40.104569 --- ParallelTerminationStrategy: PID 8216 died... 13:04:40.123891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8216): Terminated: ok {rc=0} 13:04:40.168108 --- ParallelTerminationStrategy: PID 8219 died... 13:04:40.186883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8219): Terminated: ok {rc=0} 13:04:40.231091 --- ParallelTerminationStrategy: PID 8222 died... 13:04:40.249791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8222): Terminated: ok {rc=0} 13:04:40.336395 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:04:41.552739 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:04:41.559630 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:04:41.592880 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:04:41.619498 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:04:41.671421 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:04:41.704226 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:04:41.730723 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:04:42.284228 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:04:42.339775 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:42.351541 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:04:42.423683 tst mo_mt_call.py: using LAC 21652 13:04:42.552430 tst mo_mt_call.py: using RAC 232 13:04:42.682368 tst mo_mt_call.py: using CellId 21652 13:04:42.811983 tst mo_mt_call.py: using BVCI 21653 13:04:42.932507 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:42.944093 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:42.955446 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:42.967190 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:42.978885 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:42.990643 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:04:43.113169 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:04:43.232067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:43.713176 run create_hlr_db(pid=8229): Launched 13:04:43.840124 bus /sierra_2: Setting Powered False 13:04:44.901810 run create_hlr_db(pid=8229): Terminated: ok {rc=0} 13:04:45.330629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8231): Launched 13:04:45.638263 run osmo-hlr_10.42.42.2(pid=8232): Launched 13:04:45.755569 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:46.432347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8234): Launched 13:04:46.782129 run osmo-stp_10.42.42.5(pid=8235): Launched 13:04:47.122443 run osmo-msc_10.42.42.6: Starting osmo-msc 13:04:47.713682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8237): Launched 13:04:48.023624 run osmo-msc_10.42.42.6(pid=8238): Launched 13:04:48.196048 run osmo-stp_10.42.42.5(pid=8235): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8235)] 13:04:48.326473 run osmo-stp_10.42.42.5(pid=8235): stdout: | (launched: 2022-12-09_13:04:46.720248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:48.456648 run osmo-stp_10.42.42.5(pid=8235): stderr: | 20221209130446943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130446943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130446943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130446943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130446944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130446944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130446944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:48.585294 run osmo-stp_10.42.42.5(pid=8235): stdout: | (launched: 2022-12-09_13:04:46.720248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:48.707832 run osmo-stp_10.42.42.5(pid=8235): stderr: | 20221209130446943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130446943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130446943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130446943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130446944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130446944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130446944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:48.856182 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8235): Process ended prematurely: osmo-stp_10.42.42.5(pid=8235) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8235)] [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:04:48.865157 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 13:04:48.891364 run osmo-hlr_10.42.42.2(pid=8232): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8232)] 13:04:48.939410 run osmo-hlr_10.42.42.2(pid=8232): stdout: | (launched: 2022-12-09_13:04:45.581725) 13:04:48.989301 run osmo-hlr_10.42.42.2(pid=8232): stderr: | 20221209130445760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130445760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130445760 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130445760 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130445760 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130445760 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130445774 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130445785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130445785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130445785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:49.058524 run osmo-msc_10.42.42.6(pid=8238): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8238)] 13:04:49.106874 run osmo-msc_10.42.42.6(pid=8238): stdout: | (launched: 2022-12-09_13:04:47.966519) 13:04:49.156286 run osmo-msc_10.42.42.6(pid=8238): stderr: | 20221209130448240 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130448240 DLGLOBAL DEBUG validating counter group 0x7f8a8168dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130448240 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130448240 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130448241 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130448241 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130448242 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130448243 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130448243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130448243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:49.205996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8231): Terminating (SIGTERM) 13:04:49.245913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8234): Terminating (SIGTERM) 13:04:49.285795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8237): Terminating (SIGTERM) 13:04:49.326198 --- ParallelTerminationStrategy: PID 8231 died... 13:04:49.345363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8231): Terminated: ok {rc=0} 13:04:49.389255 --- ParallelTerminationStrategy: PID 8234 died... 13:04:49.407750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8234): Terminated: ok {rc=0} 13:04:49.452284 --- ParallelTerminationStrategy: PID 8237 died... 13:04:49.471260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8237): Terminated: ok {rc=0} 13:04:49.555647 bus /sierra_3: Setting Powered False 13:04:50.655038 bus /sierra_3: Setting Powered False 13:04:51.773655 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:04:52.924686 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:52.937417 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:04:53.013109 tst mo_mt_call_osmux.py: using LAC 21653 13:04:53.140862 tst mo_mt_call_osmux.py: using RAC 233 13:04:53.267926 tst mo_mt_call_osmux.py: using CellId 21653 13:04:53.395615 tst mo_mt_call_osmux.py: using BVCI 21654 13:04:53.509242 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:53.520280 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:53.531290 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:53.542313 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:53.553294 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:53.564141 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:04:53.684210 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:04:53.805513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:54.314040 run create_hlr_db(pid=8241): Launched 13:04:54.442056 bus /sierra_2: Setting Powered False 13:04:55.506714 run create_hlr_db(pid=8241): Terminated: ok {rc=0} 13:04:55.946869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8243): Launched 13:04:56.256535 run osmo-hlr_10.42.42.2(pid=8244): Launched 13:04:56.375027 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:56.913759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8246): Launched 13:04:57.243252 run osmo-stp_10.42.42.5(pid=8247): Launched 13:04:57.370128 run osmo-msc_10.42.42.6: Starting osmo-msc 13:04:57.966824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8249): Launched 13:04:58.296735 run osmo-msc_10.42.42.6(pid=8250): Launched 13:04:58.479432 run osmo-stp_10.42.42.5(pid=8247): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8247)] 13:04:58.618560 run osmo-stp_10.42.42.5(pid=8247): stdout: | (launched: 2022-12-09_13:04:57.183219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:58.757420 run osmo-stp_10.42.42.5(pid=8247): stderr: | 20221209130457376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130457376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130457376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130457377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130457377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130457377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130457377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:58.894756 run osmo-stp_10.42.42.5(pid=8247): stdout: | (launched: 2022-12-09_13:04:57.183219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:59.025570 run osmo-stp_10.42.42.5(pid=8247): stderr: | 20221209130457376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130457376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130457376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130457377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130457377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130457377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130457377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:59.182014 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8247): Process ended prematurely: osmo-stp_10.42.42.5(pid=8247) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8247)] [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:04:59.191801 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:04:59.220879 run osmo-hlr_10.42.42.2(pid=8244): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8244)] 13:04:59.271836 run osmo-hlr_10.42.42.2(pid=8244): stdout: | (launched: 2022-12-09_13:04:56.198971) 13:04:59.324742 run osmo-hlr_10.42.42.2(pid=8244): stderr: | 20221209130456377 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130456377 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130456377 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130456378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130456378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130456378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130456390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130456398 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130456398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130456398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:59.398329 run osmo-msc_10.42.42.6(pid=8250): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8250)] 13:04:59.449645 run osmo-msc_10.42.42.6(pid=8250): stdout: | (launched: 2022-12-09_13:04:58.236678) 13:04:59.502587 run osmo-msc_10.42.42.6(pid=8250): stderr: | 20221209130458560 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130458560 DLGLOBAL DEBUG validating counter group 0x7faac5dfac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130458560 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130458560 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130458560 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130458560 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130458562 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130458562 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130458563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130458563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:59.556052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8243): Terminating (SIGTERM) 13:04:59.598927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8246): Terminating (SIGTERM) 13:04:59.641667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8249): Terminating (SIGTERM) 13:04:59.684256 --- ParallelTerminationStrategy: PID 8243 died... 13:04:59.704619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8243): Terminated: ok {rc=0} 13:04:59.751292 --- ParallelTerminationStrategy: PID 8246 died... 13:04:59.770976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8246): Terminated: ok {rc=0} 13:04:59.817548 --- ParallelTerminationStrategy: PID 8249 died... 13:04:59.837284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8249): Terminated: ok {rc=0} 13:04:59.925562 bus /sierra_3: Setting Powered False 13:05:01.024357 bus /sierra_3: Setting Powered False 13:05:02.148705 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:05:03.409186 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:05:03.415954 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:05:03.449207 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:05:03.475553 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:05:03.527217 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:05:03.560559 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:05:03.587216 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:05:04.137626 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:05:04.186527 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:05:04.197742 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:05:04.264904 tst mo_mt_call.py: using LAC 21654 13:05:04.384013 tst mo_mt_call.py: using RAC 234 13:05:04.502455 tst mo_mt_call.py: using CellId 21654 13:05:04.621975 tst mo_mt_call.py: using BVCI 21655 13:05:04.732813 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:05:04.743996 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:05:04.755029 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:05:04.766086 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:05:04.777126 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:05:04.788109 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:05:04.908543 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:05:05.030362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:05.540766 run create_hlr_db(pid=8258): Launched 13:05:05.668333 bus /sierra_2: Setting Powered False 13:05:06.732121 run create_hlr_db(pid=8258): Terminated: ok {rc=0} 13:05:07.172890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8260): Launched 13:05:07.485682 run osmo-hlr_10.42.42.2(pid=8261): Launched 13:05:07.611102 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:08.156770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8263): Launched 13:05:08.465112 run osmo-stp_10.42.42.5(pid=8264): Launched 13:05:08.583201 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:09.142021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8266): Launched 13:05:09.449915 run osmo-msc_10.42.42.6(pid=8267): Launched 13:05:09.622873 run osmo-stp_10.42.42.5(pid=8264): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8264)] 13:05:09.752937 run osmo-stp_10.42.42.5(pid=8264): stdout: | (launched: 2022-12-09_13:05:08.408144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:09.883150 run osmo-stp_10.42.42.5(pid=8264): stderr: | 20221209130508580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130508581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130508581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130508581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130508582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130508582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130508582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:10.010860 run osmo-stp_10.42.42.5(pid=8264): stdout: | (launched: 2022-12-09_13:05:08.408144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:10.133342 run osmo-stp_10.42.42.5(pid=8264): stderr: | 20221209130508580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130508581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130508581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130508581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130508582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130508582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130508582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:10.279786 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8264): Process ended prematurely: osmo-stp_10.42.42.5(pid=8264) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8264)] [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:05:10.288821 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:05:10.315228 run osmo-hlr_10.42.42.2(pid=8261): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8261)] 13:05:10.362959 run osmo-hlr_10.42.42.2(pid=8261): stdout: | (launched: 2022-12-09_13:05:07.425214) 13:05:10.412191 run osmo-hlr_10.42.42.2(pid=8261): stderr: | 20221209130507608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130507608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130507608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130507608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130507608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130507608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130507620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130507628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130507629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130507629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:10.480802 run osmo-msc_10.42.42.6(pid=8267): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8267)] 13:05:10.528699 run osmo-msc_10.42.42.6(pid=8267): stdout: | (launched: 2022-12-09_13:05:09.392748) 13:05:10.578024 run osmo-msc_10.42.42.6(pid=8267): stderr: | 20221209130509667 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130509667 DLGLOBAL DEBUG validating counter group 0x7f9e67067c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130509667 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130509667 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130509668 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130509668 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130509670 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130509670 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130509670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130509670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:10.627697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8260): Terminating (SIGTERM) 13:05:10.667488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8263): Terminating (SIGTERM) 13:05:10.707230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8266): Terminating (SIGTERM) 13:05:10.747212 --- ParallelTerminationStrategy: PID 8260 died... 13:05:10.766389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8260): Terminated: ok {rc=0} 13:05:10.810405 --- ParallelTerminationStrategy: PID 8263 died... 13:05:10.829076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8263): Terminated: ok {rc=0} 13:05:10.873409 --- ParallelTerminationStrategy: PID 8266 died... 13:05:10.892136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8266): Terminated: ok {rc=0} 13:05:10.979228 bus /sierra_3: Setting Powered False 13:05:12.081877 bus /sierra_3: Setting Powered False 13:05:13.201646 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:05:14.349880 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:05:14.361715 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:05:14.431336 tst mo_mt_call_osmux.py: using LAC 21655 13:05:14.552709 tst mo_mt_call_osmux.py: using RAC 235 13:05:14.675182 tst mo_mt_call_osmux.py: using CellId 21655 13:05:14.798697 tst mo_mt_call_osmux.py: using BVCI 21656 13:05:14.912061 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:05:14.923230 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:05:14.934291 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:05:14.945661 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:05:14.956528 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:05:14.967467 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:05:15.087646 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:05:15.205462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:15.686826 run create_hlr_db(pid=8269): Launched 13:05:15.812683 bus /sierra_2: Setting Powered False 13:05:16.889624 run create_hlr_db(pid=8269): Terminated: ok {rc=0} 13:05:17.367632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8271): Launched 13:05:17.701183 run osmo-hlr_10.42.42.2(pid=8272): Launched 13:05:17.827392 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:18.393165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8274): Launched 13:05:18.721732 run osmo-stp_10.42.42.5(pid=8275): Launched 13:05:18.849078 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:19.450884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8277): Launched 13:05:19.781254 run osmo-msc_10.42.42.6(pid=8278): Launched 13:05:19.965939 run osmo-stp_10.42.42.5(pid=8275): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8275)] 13:05:20.105846 run osmo-stp_10.42.42.5(pid=8275): stdout: | (launched: 2022-12-09_13:05:18.661700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:20.245961 run osmo-stp_10.42.42.5(pid=8275): stderr: | 20221209130518855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130518855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130518856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130518856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130518857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130518857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130518857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:20.383988 run osmo-stp_10.42.42.5(pid=8275): stdout: | (launched: 2022-12-09_13:05:18.661700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:20.515233 run osmo-stp_10.42.42.5(pid=8275): stderr: | 20221209130518855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130518855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130518856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130518856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130518857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130518857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130518857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:20.673032 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8275): Process ended prematurely: osmo-stp_10.42.42.5(pid=8275) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8275)] [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:05:20.682694 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:05:20.711656 run osmo-hlr_10.42.42.2(pid=8272): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8272)] 13:05:20.762479 run osmo-hlr_10.42.42.2(pid=8272): stdout: | (launched: 2022-12-09_13:05:17.640051) 13:05:20.814979 run osmo-hlr_10.42.42.2(pid=8272): stderr: | 20221209130517842 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130517842 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130517842 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130517842 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130517843 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130517843 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130517854 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130517863 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130517863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130517863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:20.887906 run osmo-msc_10.42.42.6(pid=8278): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8278)] 13:05:20.938672 run osmo-msc_10.42.42.6(pid=8278): stdout: | (launched: 2022-12-09_13:05:19.720678) 13:05:20.991232 run osmo-msc_10.42.42.6(pid=8278): stderr: | 20221209130520041 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130520041 DLGLOBAL DEBUG validating counter group 0x7f76a418ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130520041 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130520041 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130520041 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130520042 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130520043 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130520044 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130520044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130520044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:21.044315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8271): Terminating (SIGTERM) 13:05:21.086957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8274): Terminating (SIGTERM) 13:05:21.129575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8277): Terminating (SIGTERM) 13:05:21.172055 --- ParallelTerminationStrategy: PID 8271 died... 13:05:21.192222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8271): Terminated: ok {rc=0} 13:05:21.239031 --- ParallelTerminationStrategy: PID 8274 died... 13:05:21.258772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8274): Terminated: ok {rc=0} 13:05:21.305405 --- ParallelTerminationStrategy: PID 8277 died... 13:05:21.325116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8277): Terminated: ok {rc=0} 13:05:21.413344 bus /sierra_3: Setting Powered False 13:05:22.512763 bus /sierra_3: Setting Powered False 13:05:23.631762 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:05:24.881233 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:05:24.887697 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:05:24.920761 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:05:24.947472 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:05:25.001400 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:05:25.037716 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:05:25.064996 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:05:25.609387 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:05:25.658389 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:05:25.669683 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:05:25.738566 tst mo_mt_call.py: using LAC 21656 13:05:25.869039 tst mo_mt_call.py: using RAC 236 13:05:25.997396 tst mo_mt_call.py: using CellId 21656 13:05:26.131225 tst mo_mt_call.py: using BVCI 21657 13:05:26.251654 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:05:26.263488 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:05:26.275042 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:05:26.286781 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:05:26.298508 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:05:26.310290 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:05:26.428585 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:05:26.550315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:27.031288 run create_hlr_db(pid=8283): Launched 13:05:27.158804 bus /sierra_2: Setting Powered False 13:05:28.219787 run create_hlr_db(pid=8283): Terminated: ok {rc=0} 13:05:28.680722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8285): Launched 13:05:29.010893 run osmo-hlr_10.42.42.2(pid=8286): Launched 13:05:29.137234 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:29.702504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8288): Launched 13:05:30.031461 run osmo-stp_10.42.42.5(pid=8289): Launched 13:05:30.159007 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:30.755172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8291): Launched 13:05:31.111294 run osmo-msc_10.42.42.6(pid=8292): Launched 13:05:31.684093 run osmo-stp_10.42.42.5(pid=8289): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8289)] 13:05:32.118901 run osmo-stp_10.42.42.5(pid=8289): stdout: | (launched: 2022-12-09_13:05:29.971380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:32.273880 run osmo-stp_10.42.42.5(pid=8289): stderr: | 20221209130530165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130530165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130530165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130530166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130530166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130530166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130530166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:32.404199 run osmo-stp_10.42.42.5(pid=8289): stdout: | (launched: 2022-12-09_13:05:29.971380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:32.527399 run osmo-stp_10.42.42.5(pid=8289): stderr: | 20221209130530165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130530165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130530165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130530166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130530166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130530166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130530166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:32.674946 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8289): Process ended prematurely: osmo-stp_10.42.42.5(pid=8289) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8289)] [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:05:32.683940 tst mo_mt_call.py:8: Test FAILED (7.1 sec) 13:05:32.710473 run osmo-hlr_10.42.42.2(pid=8286): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8286)] 13:05:32.758668 run osmo-hlr_10.42.42.2(pid=8286): stdout: | (launched: 2022-12-09_13:05:28.950225) 13:05:32.808626 run osmo-hlr_10.42.42.2(pid=8286): stderr: | 20221209130529150 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130529151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130529151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130529151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130529151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130529151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130529163 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130529173 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130529173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130529174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:32.878484 run osmo-msc_10.42.42.6(pid=8292): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8292)] 13:05:32.926662 run osmo-msc_10.42.42.6(pid=8292): stdout: | (launched: 2022-12-09_13:05:31.047786) 13:05:32.976368 run osmo-msc_10.42.42.6(pid=8292): stderr: | 20221209130531597 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130531598 DLGLOBAL DEBUG validating counter group 0x7f15f7335c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130531598 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130531598 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130531598 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130531599 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130531603 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130531605 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130531605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130531605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:33.026649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8285): Terminating (SIGTERM) 13:05:33.066770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8288): Terminating (SIGTERM) 13:05:33.106815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8291): Terminating (SIGTERM) 13:05:33.147549 --- ParallelTerminationStrategy: PID 8285 died... 13:05:33.166780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8285): Terminated: ok {rc=0} 13:05:33.210940 --- ParallelTerminationStrategy: PID 8288 died... 13:05:33.229674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8288): Terminated: ok {rc=0} 13:05:33.273780 --- ParallelTerminationStrategy: PID 8291 died... 13:05:33.292558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8291): Terminated: ok {rc=0} 13:05:33.379800 bus /sierra_3: Setting Powered False 13:05:34.481901 bus /sierra_3: Setting Powered False 13:05:35.595914 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:05:36.747813 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:05:36.760482 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:05:36.832917 tst mo_mt_call_osmux.py: using LAC 21657 13:05:36.962884 tst mo_mt_call_osmux.py: using RAC 237 13:05:37.092279 tst mo_mt_call_osmux.py: using CellId 21657 13:05:37.222069 tst mo_mt_call_osmux.py: using BVCI 21658 13:05:37.342125 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:05:37.353909 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:05:37.365323 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:05:37.377621 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:05:37.389688 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:05:37.402015 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:05:37.522482 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:05:37.640530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:38.123664 run create_hlr_db(pid=8294): Launched 13:05:38.250627 bus /sierra_2: Setting Powered False 13:05:39.312013 run create_hlr_db(pid=8294): Terminated: ok {rc=0} 13:05:39.743219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8296): Launched 13:05:40.053155 run osmo-hlr_10.42.42.2(pid=8297): Launched 13:05:40.170246 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:40.702069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8299): Launched 13:05:41.010992 run osmo-stp_10.42.42.5(pid=8300): Launched 13:05:41.128635 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:41.687939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8302): Launched 13:05:41.997502 run osmo-msc_10.42.42.6(pid=8303): Launched 13:05:42.170379 run osmo-stp_10.42.42.5(pid=8300): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8300)] 13:05:42.300832 run osmo-stp_10.42.42.5(pid=8300): stdout: | (launched: 2022-12-09_13:05:40.953599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:42.431045 run osmo-stp_10.42.42.5(pid=8300): stderr: | 20221209130541124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130541124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130541124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130541124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130541125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130541125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130541125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:42.559261 run osmo-stp_10.42.42.5(pid=8300): stdout: | (launched: 2022-12-09_13:05:40.953599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:42.682172 run osmo-stp_10.42.42.5(pid=8300): stderr: | 20221209130541124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130541124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130541124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130541124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130541125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130541125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130541125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:42.829361 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8300): Process ended prematurely: osmo-stp_10.42.42.5(pid=8300) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8300)] [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:05:42.838253 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:05:42.864470 run osmo-hlr_10.42.42.2(pid=8297): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8297)] 13:05:42.911896 run osmo-hlr_10.42.42.2(pid=8297): stdout: | (launched: 2022-12-09_13:05:39.995982) 13:05:42.961311 run osmo-hlr_10.42.42.2(pid=8297): stderr: | 20221209130540175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130540175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130540175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130540175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130540175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130540175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130540220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130540229 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130540229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130540229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:43.030093 run osmo-msc_10.42.42.6(pid=8303): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8303)] 13:05:43.077767 run osmo-msc_10.42.42.6(pid=8303): stdout: | (launched: 2022-12-09_13:05:41.940335) 13:05:43.126873 run osmo-msc_10.42.42.6(pid=8303): stderr: | 20221209130542213 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130542214 DLGLOBAL DEBUG validating counter group 0x7fb343c72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130542214 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130542214 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130542214 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130542214 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130542216 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130542216 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130542216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130542216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:43.176316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8296): Terminating (SIGTERM) 13:05:43.216318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8299): Terminating (SIGTERM) 13:05:43.256289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8302): Terminating (SIGTERM) 13:05:43.296103 --- ParallelTerminationStrategy: PID 8296 died... 13:05:43.315200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8296): Terminated: ok {rc=0} 13:05:43.358931 --- ParallelTerminationStrategy: PID 8299 died... 13:05:43.377484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8299): Terminated: ok {rc=0} 13:05:43.421125 --- ParallelTerminationStrategy: PID 8302 died... 13:05:43.439586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8302): Terminated: ok {rc=0} 13:05:43.526102 bus /sierra_3: Setting Powered False 13:05:44.626992 bus /sierra_3: Setting Powered False 13:05:45.743362 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:05:47.003176 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:05:47.011828 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:05:47.061759 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:05:47.100735 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:05:47.164428 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:05:47.201720 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:05:47.231588 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:05:47.781022 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:05:47.834842 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:47.846466 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:05:47.918518 tst mo_mt_call.py: using LAC 21658 13:05:48.047899 tst mo_mt_call.py: using RAC 238 13:05:48.178554 tst mo_mt_call.py: using CellId 21658 13:05:48.303180 tst mo_mt_call.py: using BVCI 21659 13:05:48.418006 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:48.429409 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:48.440627 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:48.451906 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:48.463315 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:48.474630 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:05:48.595179 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:05:48.712697 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:49.193986 run create_hlr_db(pid=8308): Launched 13:05:49.327752 bus /sierra_2: Setting Powered False 13:05:50.393329 run create_hlr_db(pid=8308): Terminated: ok {rc=0} 13:05:50.834296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8310): Launched 13:05:51.144363 run osmo-hlr_10.42.42.2(pid=8311): Launched 13:05:51.262259 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:51.796111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8313): Launched 13:05:52.105736 run osmo-stp_10.42.42.5(pid=8314): Launched 13:05:52.225256 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:52.787350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8316): Launched 13:05:53.099224 run osmo-msc_10.42.42.6(pid=8317): Launched 13:05:53.272642 run osmo-stp_10.42.42.5(pid=8314): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8314)] 13:05:53.404444 run osmo-stp_10.42.42.5(pid=8314): stdout: | (launched: 2022-12-09_13:05:52.048517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:53.535911 run osmo-stp_10.42.42.5(pid=8314): stderr: | 20221209130552220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130552220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130552220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130552221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130552221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130552221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130552221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:53.665116 run osmo-stp_10.42.42.5(pid=8314): stdout: | (launched: 2022-12-09_13:05:52.048517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:53.788681 run osmo-stp_10.42.42.5(pid=8314): stderr: | 20221209130552220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130552220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130552220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130552221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130552221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130552221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130552221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:53.936513 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8314): Process ended prematurely: osmo-stp_10.42.42.5(pid=8314) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8314)] [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:05:53.945677 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:05:53.972110 run osmo-hlr_10.42.42.2(pid=8311): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8311)] 13:05:54.019800 run osmo-hlr_10.42.42.2(pid=8311): stdout: | (launched: 2022-12-09_13:05:51.087491) 13:05:54.069191 run osmo-hlr_10.42.42.2(pid=8311): stderr: | 20221209130551263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130551263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130551263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130551263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130551263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130551263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130551275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130551283 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130551283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130551283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:54.137785 run osmo-msc_10.42.42.6(pid=8317): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8317)] 13:05:54.185413 run osmo-msc_10.42.42.6(pid=8317): stdout: | (launched: 2022-12-09_13:05:53.041471) 13:05:54.234738 run osmo-msc_10.42.42.6(pid=8317): stderr: | 20221209130553314 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130553314 DLGLOBAL DEBUG validating counter group 0x7f0e4d2f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130553314 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130553314 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130553314 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130553315 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130553316 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130553317 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130553317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130553317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:54.284159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8310): Terminating (SIGTERM) 13:05:54.323753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8313): Terminating (SIGTERM) 13:05:54.363478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8316): Terminating (SIGTERM) 13:05:54.403447 --- ParallelTerminationStrategy: PID 8310 died... 13:05:54.422623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8310): Terminated: ok {rc=0} 13:05:54.466376 --- ParallelTerminationStrategy: PID 8313 died... 13:05:54.485083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8313): Terminated: ok {rc=0} 13:05:54.528607 --- ParallelTerminationStrategy: PID 8316 died... 13:05:54.547254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8316): Terminated: ok {rc=0} 13:05:54.634700 bus /sierra_3: Setting Powered False 13:05:55.735153 bus /sierra_3: Setting Powered False 13:05:56.850442 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:05:57.995783 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:58.007814 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:05:58.076839 tst mo_mt_call_osmux.py: using LAC 21659 13:05:58.199039 tst mo_mt_call_osmux.py: using RAC 239 13:05:58.321608 tst mo_mt_call_osmux.py: using CellId 21659 13:05:58.443807 tst mo_mt_call_osmux.py: using BVCI 21660 13:05:58.557796 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:58.569485 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:58.580562 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:58.591487 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:58.602659 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:58.613850 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:05:58.730623 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:05:58.852573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:59.364302 run create_hlr_db(pid=8319): Launched 13:05:59.491126 bus /sierra_2: Setting Powered False 13:06:00.555777 run create_hlr_db(pid=8319): Terminated: ok {rc=0} 13:06:01.031868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8321): Launched 13:06:01.377484 run osmo-hlr_10.42.42.2(pid=8322): Launched 13:06:01.674651 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:02.453545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8324): Launched 13:06:02.784170 run osmo-stp_10.42.42.5(pid=8325): Launched 13:06:02.910530 run osmo-msc_10.42.42.6: Starting osmo-msc 13:06:03.508360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8327): Launched 13:06:03.838220 run osmo-msc_10.42.42.6(pid=8328): Launched 13:06:04.023338 run osmo-stp_10.42.42.5(pid=8325): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8325)] 13:06:04.162132 run osmo-stp_10.42.42.5(pid=8325): stdout: | (launched: 2022-12-09_13:06:02.723856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:04.301797 run osmo-stp_10.42.42.5(pid=8325): stderr: | 20221209130602916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130602916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130602916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130602917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130602917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130602917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130602917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:04.439470 run osmo-stp_10.42.42.5(pid=8325): stdout: | (launched: 2022-12-09_13:06:02.723856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:04.571023 run osmo-stp_10.42.42.5(pid=8325): stderr: | 20221209130602916 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130602916 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130602916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130602917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130602917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130602917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130602917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:04.727609 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8325): Process ended prematurely: osmo-stp_10.42.42.5(pid=8325) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8325)] [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:06:04.737277 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 13:06:04.766098 run osmo-hlr_10.42.42.2(pid=8322): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8322)] 13:06:04.816879 run osmo-hlr_10.42.42.2(pid=8322): stdout: | (launched: 2022-12-09_13:06:01.315610) 13:06:04.869304 run osmo-hlr_10.42.42.2(pid=8322): stderr: | 20221209130601774 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130601774 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130601774 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130601774 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130601774 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130601774 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130601791 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130601806 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130601807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130601807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:04.942411 run osmo-msc_10.42.42.6(pid=8328): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8328)] 13:06:04.993075 run osmo-msc_10.42.42.6(pid=8328): stdout: | (launched: 2022-12-09_13:06:03.777846) 13:06:05.045371 run osmo-msc_10.42.42.6(pid=8328): stderr: | 20221209130604101 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130604101 DLGLOBAL DEBUG validating counter group 0x7f88a7657c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130604101 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130604101 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130604101 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130604101 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130604103 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130604103 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130604104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130604104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:06:05.097968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8321): Terminating (SIGTERM) 13:06:05.140294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8324): Terminating (SIGTERM) 13:06:05.182612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8327): Terminating (SIGTERM) 13:06:05.225220 --- ParallelTerminationStrategy: PID 8321 died... 13:06:05.245373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8321): Terminated: ok {rc=0} 13:06:05.292365 --- ParallelTerminationStrategy: PID 8324 died... 13:06:05.312021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8324): Terminated: ok {rc=0} 13:06:05.358716 --- ParallelTerminationStrategy: PID 8327 died... 13:06:05.378404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8327): Terminated: ok {rc=0} 13:06:05.467286 bus /sierra_3: Setting Powered False 13:06:06.568048 bus /sierra_3: Setting Powered False 13:06:07.687881 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:06:08.938423 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:06:08.944864 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:06:08.978520 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:06:09.005488 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:06:09.056217 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:06:09.089734 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:06:09.116537 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:06:09.666969 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:06:09.716818 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:06:09.728193 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:06:09.796306 tst mo_mt_call.py: using LAC 21660 13:06:09.916910 tst mo_mt_call.py: using RAC 240 13:06:10.036707 tst mo_mt_call.py: using CellId 21660 13:06:10.160189 tst mo_mt_call.py: using BVCI 21661 13:06:10.281552 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:06:10.293146 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:06:10.304479 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:06:10.316313 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:06:10.327988 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:06:10.339745 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:06:10.457859 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:06:10.575534 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:11.057039 run create_hlr_db(pid=8333): Launched 13:06:11.184055 bus /sierra_2: Setting Powered False 13:06:12.245092 run create_hlr_db(pid=8333): Terminated: ok {rc=0} 13:06:12.675214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8335): Launched 13:06:12.983507 run osmo-hlr_10.42.42.2(pid=8336): Launched 13:06:13.101591 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:13.633653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8338): Launched 13:06:13.943950 run osmo-stp_10.42.42.5(pid=8339): Launched 13:06:14.061386 run osmo-msc_10.42.42.6: Starting osmo-msc 13:06:14.619150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8341): Launched 13:06:14.928764 run osmo-msc_10.42.42.6(pid=8342): Launched 13:06:15.100939 run osmo-stp_10.42.42.5(pid=8339): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8339)] 13:06:15.230826 run osmo-stp_10.42.42.5(pid=8339): stdout: | (launched: 2022-12-09_13:06:13.885846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:15.360793 run osmo-stp_10.42.42.5(pid=8339): stderr: | 20221209130614058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130614058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130614059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130614059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130614060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130614060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130614060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:15.489937 run osmo-stp_10.42.42.5(pid=8339): stdout: | (launched: 2022-12-09_13:06:13.885846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:15.612612 run osmo-stp_10.42.42.5(pid=8339): stderr: | 20221209130614058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130614058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130614059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130614059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130614060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130614060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130614060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:15.759335 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8339): Process ended prematurely: osmo-stp_10.42.42.5(pid=8339) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8339)] [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:06:15.768489 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:06:15.795292 run osmo-hlr_10.42.42.2(pid=8336): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8336)] 13:06:15.854815 run osmo-hlr_10.42.42.2(pid=8336): stdout: | (launched: 2022-12-09_13:06:12.926608) 13:06:15.912611 run osmo-hlr_10.42.42.2(pid=8336): stderr: | 20221209130613104 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130613104 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130613104 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130613104 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130613104 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130613105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130613117 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130613126 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130613127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130613127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:15.992627 run osmo-msc_10.42.42.6(pid=8342): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8342)] 13:06:16.046504 run osmo-msc_10.42.42.6(pid=8342): stdout: | (launched: 2022-12-09_13:06:14.870826) 13:06:16.101538 run osmo-msc_10.42.42.6(pid=8342): stderr: | 20221209130615146 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130615146 DLGLOBAL DEBUG validating counter group 0x7fa15b26ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130615146 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130615146 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130615146 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130615147 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130615149 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130615149 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130615149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130615149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:06:16.158249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8335): Terminating (SIGTERM) 13:06:16.203823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8338): Terminating (SIGTERM) 13:06:16.250332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8341): Terminating (SIGTERM) 13:06:16.297141 --- ParallelTerminationStrategy: PID 8335 died... 13:06:16.318244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8335): Terminated: ok {rc=0} 13:06:16.370659 --- ParallelTerminationStrategy: PID 8338 died... 13:06:16.391492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8338): Terminated: ok {rc=0} 13:06:16.442607 --- ParallelTerminationStrategy: PID 8341 died... 13:06:16.463492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8341): Terminated: ok {rc=0} 13:06:16.560026 bus /sierra_3: Setting Powered False 13:06:17.662983 bus /sierra_3: Setting Powered False 13:06:18.781071 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:06:19.933068 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:06:19.945589 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:06:20.022301 tst mo_mt_call_osmux.py: using LAC 21661 13:06:20.150274 tst mo_mt_call_osmux.py: using RAC 241 13:06:20.278315 tst mo_mt_call_osmux.py: using CellId 21661 13:06:20.405812 tst mo_mt_call_osmux.py: using BVCI 21662 13:06:20.527376 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:06:20.539089 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:06:20.550632 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:06:20.562596 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:06:20.574467 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:06:20.586626 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:06:20.705939 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:06:20.828859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:21.340559 run create_hlr_db(pid=8344): Launched 13:06:21.466166 bus /sierra_2: Setting Powered False 13:06:22.530908 run create_hlr_db(pid=8344): Terminated: ok {rc=0} 13:06:22.989040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8346): Launched 13:06:23.318974 run osmo-hlr_10.42.42.2(pid=8347): Launched 13:06:23.446849 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:24.019277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8349): Launched 13:06:24.350288 run osmo-stp_10.42.42.5(pid=8350): Launched 13:06:24.475985 run osmo-msc_10.42.42.6: Starting osmo-msc 13:06:25.072428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8352): Launched 13:06:25.403865 run osmo-msc_10.42.42.6(pid=8353): Launched 13:06:25.588560 run osmo-stp_10.42.42.5(pid=8350): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8350)] 13:06:25.728474 run osmo-stp_10.42.42.5(pid=8350): stdout: | (launched: 2022-12-09_13:06:24.289362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:25.868200 run osmo-stp_10.42.42.5(pid=8350): stderr: | 20221209130624481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130624481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130624481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130624482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130624482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130624482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130624482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:26.006526 run osmo-stp_10.42.42.5(pid=8350): stdout: | (launched: 2022-12-09_13:06:24.289362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:26.138226 run osmo-stp_10.42.42.5(pid=8350): stderr: | 20221209130624481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130624481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130624481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130624482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130624482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130624482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130624482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:26.295749 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8350): Process ended prematurely: osmo-stp_10.42.42.5(pid=8350) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8350)] [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:06:26.305484 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:06:26.334039 run osmo-hlr_10.42.42.2(pid=8347): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8347)] 13:06:26.384903 run osmo-hlr_10.42.42.2(pid=8347): stdout: | (launched: 2022-12-09_13:06:23.258640) 13:06:26.437642 run osmo-hlr_10.42.42.2(pid=8347): stderr: | 20221209130623458 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130623458 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130623458 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130623458 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130623458 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130623458 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130623470 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130623479 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130623479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130623479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:26.511103 run osmo-msc_10.42.42.6(pid=8353): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8353)] 13:06:26.562141 run osmo-msc_10.42.42.6(pid=8353): stdout: | (launched: 2022-12-09_13:06:25.343047) 13:06:26.614851 run osmo-msc_10.42.42.6(pid=8353): stderr: | 20221209130625666 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130625666 DLGLOBAL DEBUG validating counter group 0x7fd979bc9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130625666 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130625666 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130625666 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130625666 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130625668 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130625669 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130625669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130625669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:06:26.667901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8346): Terminating (SIGTERM) 13:06:26.710542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8349): Terminating (SIGTERM) 13:06:26.753119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8352): Terminating (SIGTERM) 13:06:26.795591 --- ParallelTerminationStrategy: PID 8346 died... 13:06:26.816081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8346): Terminated: ok {rc=0} 13:06:26.863189 --- ParallelTerminationStrategy: PID 8349 died... 13:06:26.882931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8349): Terminated: ok {rc=0} 13:06:26.929867 --- ParallelTerminationStrategy: PID 8352 died... 13:06:26.949635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8352): Terminated: ok {rc=0} 13:06:27.038215 bus /sierra_3: Setting Powered False 13:06:28.137860 bus /sierra_3: Setting Powered False 13:06:29.254320 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:06:30.509630 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:06:30.516637 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:06:30.552343 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:06:30.580549 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:06:30.633736 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:06:30.668076 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:06:30.695812 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:06:31.254586 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:06:31.311016 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:31.323654 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:06:31.398865 tst mo_mt_call.py: using LAC 21662 13:06:31.547589 tst mo_mt_call.py: using RAC 242 13:06:31.685054 tst mo_mt_call.py: using CellId 21662 13:06:31.821034 tst mo_mt_call.py: using BVCI 21663 13:06:31.972374 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:31.985188 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:31.999067 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:32.011703 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:32.026745 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:32.040367 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:06:32.167181 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:06:32.291846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:32.804428 run create_hlr_db(pid=8359): Launched 13:06:32.931701 bus /sierra_2: Setting Powered False 13:06:33.997401 run create_hlr_db(pid=8359): Terminated: ok {rc=0} 13:06:34.454342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8361): Launched 13:06:34.785651 run osmo-hlr_10.42.42.2(pid=8362): Launched 13:06:34.911565 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:35.477416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8364): Launched 13:06:35.807578 run osmo-stp_10.42.42.5(pid=8365): Launched 13:06:35.932762 run osmo-msc_10.42.42.6: Starting osmo-msc 13:06:36.526797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8367): Launched 13:06:36.857373 run osmo-msc_10.42.42.6(pid=8368): Launched 13:06:37.043016 run osmo-stp_10.42.42.5(pid=8365): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8365)] 13:06:37.182273 run osmo-stp_10.42.42.5(pid=8365): stdout: | (launched: 2022-12-09_13:06:35.747050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:37.321825 run osmo-stp_10.42.42.5(pid=8365): stderr: | 20221209130635941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130635941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130635941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130635941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130635942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130635942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130635942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:37.459945 run osmo-stp_10.42.42.5(pid=8365): stdout: | (launched: 2022-12-09_13:06:35.747050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:37.591581 run osmo-stp_10.42.42.5(pid=8365): stderr: | 20221209130635941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130635941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130635941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130635941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130635942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130635942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130635942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:37.749135 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8365): Process ended prematurely: osmo-stp_10.42.42.5(pid=8365) [trial-2360↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8365)] [trial-2360↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:06:37.758650 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 13:06:37.787137 run osmo-hlr_10.42.42.2(pid=8362): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8362)] 13:06:37.837698 run osmo-hlr_10.42.42.2(pid=8362): stdout: | (launched: 2022-12-09_13:06:34.725088) 13:06:37.890135 run osmo-hlr_10.42.42.2(pid=8362): stderr: | 20221209130634923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130634923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130634923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130634923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130634923 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130634923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130634933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130634943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130634943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130634943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:37.963133 run osmo-msc_10.42.42.6(pid=8368): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8368)] 13:06:38.014280 run osmo-msc_10.42.42.6(pid=8368): stdout: | (launched: 2022-12-09_13:06:36.797127) 13:06:38.066707 run osmo-msc_10.42.42.6(pid=8368): stderr: | 20221209130637119 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130637119 DLGLOBAL DEBUG validating counter group 0x7faff3d34c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130637119 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130637119 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130637120 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130637120 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130637121 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130637122 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130637122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130637122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:06:38.119395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8361): Terminating (SIGTERM) 13:06:38.161654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8364): Terminating (SIGTERM) 13:06:38.204107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8367): Terminating (SIGTERM) 13:06:38.246517 --- ParallelTerminationStrategy: PID 8361 died... 13:06:38.266520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8361): Terminated: ok {rc=0} 13:06:38.313158 --- ParallelTerminationStrategy: PID 8364 died... 13:06:38.332621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8364): Terminated: ok {rc=0} 13:06:38.379187 --- ParallelTerminationStrategy: PID 8367 died... 13:06:38.398867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8367): Terminated: ok {rc=0} 13:06:38.486828 bus /sierra_3: Setting Powered False 13:06:39.588077 bus /sierra_3: Setting Powered False 13:06:40.705348 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:06:41.851028 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:41.863168 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:06:41.933419 tst mo_mt_call_osmux.py: using LAC 21663 13:06:42.060568 tst mo_mt_call_osmux.py: using RAC 243 13:06:42.181561 tst mo_mt_call_osmux.py: using CellId 21663 13:06:42.301017 tst mo_mt_call_osmux.py: using BVCI 21664 13:06:42.413508 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:42.424826 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:42.435906 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:42.446980 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:42.458184 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:42.469296 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:06:42.589686 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:06:42.706571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:43.187258 run create_hlr_db(pid=8370): Launched 13:06:43.313636 bus /sierra_2: Setting Powered False 13:06:44.374695 run create_hlr_db(pid=8370): Terminated: ok {rc=0} 13:06:44.825505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8372): Launched 13:06:45.154810 run osmo-hlr_10.42.42.2(pid=8373): Launched 13:06:45.282313 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:45.857712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8375): Launched 13:06:46.195958 run osmo-stp_10.42.42.5(pid=8376): Launched 13:06:46.472870 run osmo-msc_10.42.42.6: Starting osmo-msc 13:06:47.141852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8378): Launched 13:06:47.495926 run osmo-msc_10.42.42.6(pid=8379): Launched 13:06:47.681300 run osmo-stp_10.42.42.5(pid=8376): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8376)] 13:06:47.822554 run osmo-stp_10.42.42.5(pid=8376): stdout: | (launched: 2022-12-09_13:06:46.136127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:47.962810 run osmo-stp_10.42.42.5(pid=8376): stderr: | 20221209130646479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130646479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130646481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130646481 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130646483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130646483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130646483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:48.101377 run osmo-stp_10.42.42.5(pid=8376): stdout: | (launched: 2022-12-09_13:06:46.136127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:48.232706 run osmo-stp_10.42.42.5(pid=8376): stderr: | 20221209130646479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130646479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130646481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130646481 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130646483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130646483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130646483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:48.390297 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8376): Process ended prematurely: osmo-stp_10.42.42.5(pid=8376) [trial-2360↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8376)] [trial-2360↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:06:48.399880 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 13:06:48.428285 run osmo-hlr_10.42.42.2(pid=8373): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8373)] 13:06:48.479158 run osmo-hlr_10.42.42.2(pid=8373): stdout: | (launched: 2022-12-09_13:06:45.094670) 13:06:48.531699 run osmo-hlr_10.42.42.2(pid=8373): stderr: | 20221209130645292 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130645292 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130645292 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130645292 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130645293 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130645293 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130645304 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130645315 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130645315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130645315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:48.605756 run osmo-msc_10.42.42.6(pid=8379): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8379)] 13:06:48.656939 run osmo-msc_10.42.42.6(pid=8379): stdout: | (launched: 2022-12-09_13:06:47.435364) 13:06:48.709594 run osmo-msc_10.42.42.6(pid=8379): stderr: | 20221209130647759 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130647759 DLGLOBAL DEBUG validating counter group 0x7f8f786c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130647759 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130647759 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130647759 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130647759 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130647761 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130647762 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130647762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130647762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:06:48.762692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8372): Terminating (SIGTERM) 13:06:48.804876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8375): Terminating (SIGTERM) 13:06:48.847264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8378): Terminating (SIGTERM) 13:06:48.889423 --- ParallelTerminationStrategy: PID 8372 died... 13:06:48.909640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8372): Terminated: ok {rc=0} 13:06:48.956260 --- ParallelTerminationStrategy: PID 8375 died... 13:06:48.976126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8375): Terminated: ok {rc=0} 13:06:49.023049 --- ParallelTerminationStrategy: PID 8378 died... 13:06:49.042911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8378): Terminated: ok {rc=0} 13:06:49.133072 bus /sierra_3: Setting Powered False 13:06:50.235433 bus /sierra_3: Setting Powered False 13:06:51.355002 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:06:52.609769 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:06:52.615875 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:06:52.649495 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:06:52.676310 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:06:52.730515 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:06:52.766388 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:06:52.794427 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:06:53.337617 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:06:53.387008 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:53.398131 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:06:53.468567 tst mo_mt_call.py: using LAC 21664 13:06:53.589394 tst mo_mt_call.py: using RAC 244 13:06:53.710590 tst mo_mt_call.py: using CellId 21664 13:06:53.834555 tst mo_mt_call.py: using BVCI 21665 13:06:53.949177 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:53.960013 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:53.970806 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:53.981561 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:53.992309 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:54.003127 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:06:54.117488 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:06:54.233552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:54.715033 run create_hlr_db(pid=8384): Launched 13:06:54.841610 bus /sierra_2: Setting Powered False 13:06:55.903106 run create_hlr_db(pid=8384): Terminated: ok {rc=0} 13:06:56.354788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8386): Launched 13:06:56.687431 run osmo-hlr_10.42.42.2(pid=8387): Launched 13:06:56.813372 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:57.380093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8389): Launched 13:06:57.711965 run osmo-stp_10.42.42.5(pid=8390): Launched 13:06:57.837984 run osmo-msc_10.42.42.6: Starting osmo-msc 13:06:58.435247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8392): Launched 13:06:58.768895 run osmo-msc_10.42.42.6(pid=8393): Launched 13:06:58.953461 run osmo-stp_10.42.42.5(pid=8390): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8390)] 13:06:59.093101 run osmo-stp_10.42.42.5(pid=8390): stdout: | (launched: 2022-12-09_13:06:57.651276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:59.233170 run osmo-stp_10.42.42.5(pid=8390): stderr: | 20221209130657846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130657846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130657847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130657847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130657847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130657847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130657848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:59.371531 run osmo-stp_10.42.42.5(pid=8390): stdout: | (launched: 2022-12-09_13:06:57.651276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:59.503036 run osmo-stp_10.42.42.5(pid=8390): stderr: | 20221209130657846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130657846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130657847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130657847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130657847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130657847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130657848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:59.661302 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8390): Process ended prematurely: osmo-stp_10.42.42.5(pid=8390) [trial-2360↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8390)] [trial-2360↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:06:59.671250 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:06:59.699997 run osmo-hlr_10.42.42.2(pid=8387): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8387)] 13:06:59.751307 run osmo-hlr_10.42.42.2(pid=8387): stdout: | (launched: 2022-12-09_13:06:56.626187) 13:06:59.804365 run osmo-hlr_10.42.42.2(pid=8387): stderr: | 20221209130656826 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130656826 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130656827 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130656827 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130656827 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130656827 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130656839 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130656849 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130656849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130656850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:59.878310 run osmo-msc_10.42.42.6(pid=8393): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8393)] 13:06:59.929760 run osmo-msc_10.42.42.6(pid=8393): stdout: | (launched: 2022-12-09_13:06:58.707780) 13:06:59.982908 run osmo-msc_10.42.42.6(pid=8393): stderr: | 20221209130659031 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130659031 DLGLOBAL DEBUG validating counter group 0x7fe53c9a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130659031 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130659031 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130659031 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130659031 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130659033 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130659033 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130659034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130659034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:07:00.036306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8386): Terminating (SIGTERM) 13:07:00.079307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8389): Terminating (SIGTERM) 13:07:00.122028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8392): Terminating (SIGTERM) 13:07:00.164820 --- ParallelTerminationStrategy: PID 8386 died... 13:07:00.185155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8386): Terminated: ok {rc=0} 13:07:00.232882 --- ParallelTerminationStrategy: PID 8389 died... 13:07:00.253085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8389): Terminated: ok {rc=0} 13:07:00.300091 --- ParallelTerminationStrategy: PID 8392 died... 13:07:00.320027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8392): Terminated: ok {rc=0} 13:07:00.409555 bus /sierra_3: Setting Powered False 13:07:01.509904 bus /sierra_3: Setting Powered False 13:07:02.627868 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:07:03.779569 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:07:03.791822 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:07:03.864828 tst mo_mt_call_osmux.py: using LAC 21665 13:07:03.994557 tst mo_mt_call_osmux.py: using RAC 245 13:07:04.123306 tst mo_mt_call_osmux.py: using CellId 21665 13:07:04.253953 tst mo_mt_call_osmux.py: using BVCI 21666 13:07:04.374298 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:07:04.385816 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:07:04.397141 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:07:04.408612 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:07:04.420215 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:07:04.433469 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:07:04.553261 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:07:04.674176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:05.185168 run create_hlr_db(pid=8395): Launched 13:07:05.311130 bus /sierra_2: Setting Powered False 13:07:06.372522 run create_hlr_db(pid=8395): Terminated: ok {rc=0} 13:07:06.831620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8397): Launched 13:07:07.163256 run osmo-hlr_10.42.42.2(pid=8398): Launched 13:07:07.290877 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:07.862390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8400): Launched 13:07:08.192620 run osmo-stp_10.42.42.5(pid=8401): Launched 13:07:08.318262 run osmo-msc_10.42.42.6: Starting osmo-msc 13:07:08.916171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8403): Launched 13:07:09.248003 run osmo-msc_10.42.42.6(pid=8404): Launched 13:07:09.432862 run osmo-stp_10.42.42.5(pid=8401): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8401)] 13:07:09.571998 run osmo-stp_10.42.42.5(pid=8401): stdout: | (launched: 2022-12-09_13:07:08.131759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:09.712302 run osmo-stp_10.42.42.5(pid=8401): stderr: | 20221209130708325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130708326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130708326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130708326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130708327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130708327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130708327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:09.851183 run osmo-stp_10.42.42.5(pid=8401): stdout: | (launched: 2022-12-09_13:07:08.131759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:09.983232 run osmo-stp_10.42.42.5(pid=8401): stderr: | 20221209130708325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130708326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130708326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130708326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130708327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130708327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130708327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:10.140792 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8401): Process ended prematurely: osmo-stp_10.42.42.5(pid=8401) [trial-2360↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8401)] [trial-2360↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:07:10.150527 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:07:10.179420 run osmo-hlr_10.42.42.2(pid=8398): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8398)] 13:07:10.230245 run osmo-hlr_10.42.42.2(pid=8398): stdout: | (launched: 2022-12-09_13:07:07.102790) 13:07:10.283112 run osmo-hlr_10.42.42.2(pid=8398): stderr: | 20221209130707303 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130707303 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130707303 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130707303 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130707303 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130707303 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130707315 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130707324 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130707324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130707324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:10.356575 run osmo-msc_10.42.42.6(pid=8404): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8404)] 13:07:10.407618 run osmo-msc_10.42.42.6(pid=8404): stdout: | (launched: 2022-12-09_13:07:09.187379) 13:07:10.460242 run osmo-msc_10.42.42.6(pid=8404): stderr: | 20221209130709510 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130709510 DLGLOBAL DEBUG validating counter group 0x7f4321ef7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130709510 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130709510 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130709511 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130709511 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130709512 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130709513 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130709513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130709513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:07:10.513339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8397): Terminating (SIGTERM) 13:07:10.556282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8400): Terminating (SIGTERM) 13:07:10.599032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8403): Terminating (SIGTERM) 13:07:10.642166 --- ParallelTerminationStrategy: PID 8397 died... 13:07:10.662681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8397): Terminated: ok {rc=0} 13:07:10.709841 --- ParallelTerminationStrategy: PID 8400 died... 13:07:10.729476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8400): Terminated: ok {rc=0} 13:07:10.776612 --- ParallelTerminationStrategy: PID 8403 died... 13:07:10.796558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8403): Terminated: ok {rc=0} 13:07:10.886419 bus /sierra_3: Setting Powered False 13:07:11.985036 bus /sierra_3: Setting Powered False 13:07:13.101195 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 13:07:14.354497 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:07:14.359353 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 13:07:14.392409 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 13:07:14.418970 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 13:07:14.471107 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 13:07:14.504281 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 13:07:14.530862 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 13:07:15.079322 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 13:07:15.128755 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:07:15.139850 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 13:07:15.188562 tst mo_mt_call.py: using LAC 21666 13:07:15.308402 tst mo_mt_call.py: using RAC 246 13:07:15.429003 tst mo_mt_call.py: using CellId 21666 13:07:15.549516 tst mo_mt_call.py: using BVCI 21667 13:07:15.662020 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:07:15.673250 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:07:15.684082 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:07:15.694848 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:07:15.705617 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:07:15.716447 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 13:07:15.836606 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 13:07:15.975026 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:16.517615 run create_hlr_db(pid=8409): Launched 13:07:16.683265 bus /sierra_2: Setting Powered False 13:07:17.743935 run create_hlr_db(pid=8409): Terminated: ok {rc=0} 13:07:18.210736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8411): Launched 13:07:18.542807 run osmo-hlr_10.42.42.2(pid=8412): Launched 13:07:18.671300 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:19.235253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8414): Launched 13:07:19.567161 run osmo-stp_10.42.42.5(pid=8415): Launched 13:07:19.695485 run osmo-msc_10.42.42.6: Starting osmo-msc 13:07:20.291860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8417): Launched 13:07:20.623906 run osmo-msc_10.42.42.6(pid=8418): Launched 13:07:20.807466 run osmo-stp_10.42.42.5(pid=8415): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8415)] 13:07:20.946131 run osmo-stp_10.42.42.5(pid=8415): stdout: | (launched: 2022-12-09_13:07:19.507008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:21.085464 run osmo-stp_10.42.42.5(pid=8415): stderr: | 20221209130719699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130719699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130719699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130719700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130719700 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130719700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130719700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:21.223912 run osmo-stp_10.42.42.5(pid=8415): stdout: | (launched: 2022-12-09_13:07:19.507008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:21.355727 run osmo-stp_10.42.42.5(pid=8415): stderr: | 20221209130719699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130719699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130719699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130719700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130719700 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130719700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130719700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:21.512921 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8415): Process ended prematurely: osmo-stp_10.42.42.5(pid=8415) [trial-2360↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8415)] [trial-2360↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 13:07:21.522707 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:07:21.551458 run osmo-hlr_10.42.42.2(pid=8412): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8412)] 13:07:21.602118 run osmo-hlr_10.42.42.2(pid=8412): stdout: | (launched: 2022-12-09_13:07:18.482634) 13:07:21.654688 run osmo-hlr_10.42.42.2(pid=8412): stderr: | 20221209130718681 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130718682 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130718682 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130718682 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130718682 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130718682 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130718695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130718705 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130718705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130718705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:21.727642 run osmo-msc_10.42.42.6(pid=8418): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8418)] 13:07:21.778209 run osmo-msc_10.42.42.6(pid=8418): stdout: | (launched: 2022-12-09_13:07:20.563120) 13:07:21.830319 run osmo-msc_10.42.42.6(pid=8418): stderr: | 20221209130720887 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130720887 DLGLOBAL DEBUG validating counter group 0x7fb878381c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130720887 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130720887 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130720887 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130720887 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130720889 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130720890 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130720890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130720890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:07:21.883021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8411): Terminating (SIGTERM) 13:07:21.925356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8414): Terminating (SIGTERM) 13:07:21.967890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8417): Terminating (SIGTERM) 13:07:22.010400 --- ParallelTerminationStrategy: PID 8411 died... 13:07:22.030550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8411): Terminated: ok {rc=0} 13:07:22.077195 --- ParallelTerminationStrategy: PID 8414 died... 13:07:22.096671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8414): Terminated: ok {rc=0} 13:07:22.142874 --- ParallelTerminationStrategy: PID 8417 died... 13:07:22.162395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8417): Terminated: ok {rc=0} 13:07:22.251266 bus /sierra_3: Setting Powered False 13:07:23.349829 bus /sierra_3: Setting Powered False 13:07:24.465463 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 13:07:25.612546 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:07:25.624324 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 13:07:25.676863 tst mo_mt_call_osmux.py: using LAC 21667 13:07:25.799464 tst mo_mt_call_osmux.py: using RAC 247 13:07:25.920759 tst mo_mt_call_osmux.py: using CellId 21667 13:07:26.039919 tst mo_mt_call_osmux.py: using BVCI 21668 13:07:26.152153 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:07:26.163250 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:07:26.174081 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:07:26.184837 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:07:26.195734 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:07:26.206601 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 13:07:26.325531 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 13:07:26.442312 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:26.957609 run create_hlr_db(pid=8420): Launched 13:07:27.084418 bus /sierra_2: Setting Powered False 13:07:28.149786 run create_hlr_db(pid=8420): Terminated: ok {rc=0} 13:07:28.592808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8422): Launched 13:07:28.903275 run osmo-hlr_10.42.42.2(pid=8423): Launched 13:07:29.023371 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:29.558268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8425): Launched 13:07:29.869953 run osmo-stp_10.42.42.5(pid=8426): Launched 13:07:29.988222 run osmo-msc_10.42.42.6: Starting osmo-msc 13:07:30.552792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8428): Launched 13:07:30.893661 run osmo-msc_10.42.42.6(pid=8429): Launched 13:07:31.186423 run osmo-stp_10.42.42.5(pid=8426): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8426)] 13:07:31.478793 run osmo-stp_10.42.42.5(pid=8426): stdout: | (launched: 2022-12-09_13:07:29.812317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:31.733542 run osmo-stp_10.42.42.5(pid=8426): stderr: | 20221209130729983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130729983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130729983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130729983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130729984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130729984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130729984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:31.927115 run osmo-stp_10.42.42.5(pid=8426): stdout: | (launched: 2022-12-09_13:07:29.812317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:32.080838 run osmo-stp_10.42.42.5(pid=8426): stderr: | 20221209130729983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130729983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130729983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130729983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130729984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130729984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130729984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:32.250924 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8426): Process ended prematurely: osmo-stp_10.42.42.5(pid=8426) [trial-2360↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8426)] [trial-2360↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 13:07:32.261737 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 13:07:32.292096 run osmo-hlr_10.42.42.2(pid=8423): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8423)] 13:07:32.348199 run osmo-hlr_10.42.42.2(pid=8423): stdout: | (launched: 2022-12-09_13:07:28.846201) 13:07:32.403587 run osmo-hlr_10.42.42.2(pid=8423): stderr: | 20221209130729024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130729024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130729024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130729024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130729024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130729024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130729036 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130729045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130729045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130729045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:32.478923 run osmo-msc_10.42.42.6(pid=8429): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8429)] 13:07:32.529933 run osmo-msc_10.42.42.6(pid=8429): stdout: | (launched: 2022-12-09_13:07:30.805960) 13:07:32.582878 run osmo-msc_10.42.42.6(pid=8429): stderr: | 20221209130731531 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130731531 DLGLOBAL DEBUG validating counter group 0x7fb4ff6b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130731531 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130731531 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130731532 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130731532 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130731533 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130731534 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130731534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130731534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:07:32.636638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8422): Terminating (SIGTERM) 13:07:32.679505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8425): Terminating (SIGTERM) 13:07:32.722182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8428): Terminating (SIGTERM) 13:07:32.765139 --- ParallelTerminationStrategy: PID 8422 died... 13:07:32.785339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8422): Terminated: ok {rc=0} 13:07:32.832511 --- ParallelTerminationStrategy: PID 8425 died... 13:07:32.852421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8425): Terminated: ok {rc=0} 13:07:32.899494 --- ParallelTerminationStrategy: PID 8428 died... 13:07:32.919185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8428): Terminated: ok {rc=0} 13:07:33.007836 bus /sierra_3: Setting Powered False 13:07:34.106621 bus /sierra_3: Setting Powered False 13:07:35.223338 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:07:36.480661 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:07:36.487439 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:07:36.522120 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 13:07:36.549891 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 13:07:36.600906 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:07:36.635619 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 13:07:36.663525 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 13:07:37.216793 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 13:07:37.266660 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:07:37.278263 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:07:37.329032 tst mo_mt_call.py: using LAC 21668 13:07:37.449090 tst mo_mt_call.py: using RAC 248 13:07:37.569299 tst mo_mt_call.py: using CellId 21668 13:07:37.692343 tst mo_mt_call.py: using BVCI 21669 13:07:37.804626 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:07:37.816074 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:07:37.827201 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:07:37.838439 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:07:37.849758 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:07:37.860918 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:07:37.980853 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:07:38.103916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:38.617669 run create_hlr_db(pid=8436): Launched 13:07:38.746836 bus /sierra_2: Setting Powered False 13:07:39.811658 run create_hlr_db(pid=8436): Terminated: ok {rc=0} 13:07:40.255065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8438): Launched 13:07:40.566625 run osmo-hlr_10.42.42.2(pid=8439): Launched 13:07:40.685779 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:41.226539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8441): Launched 13:07:41.539456 run osmo-stp_10.42.42.5(pid=8442): Launched 13:07:41.659987 run osmo-msc_10.42.42.6: Starting osmo-msc 13:07:42.221279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8444): Launched 13:07:42.532080 run osmo-msc_10.42.42.6(pid=8445): Launched 13:07:42.706523 run osmo-stp_10.42.42.5(pid=8442): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8442)] 13:07:42.837512 run osmo-stp_10.42.42.5(pid=8442): stdout: | (launched: 2022-12-09_13:07:41.482245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:42.968384 run osmo-stp_10.42.42.5(pid=8442): stderr: | 20221209130741655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130741655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130741656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130741656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130741657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130741657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130741657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:43.098003 run osmo-stp_10.42.42.5(pid=8442): stdout: | (launched: 2022-12-09_13:07:41.482245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:43.221684 run osmo-stp_10.42.42.5(pid=8442): stderr: | 20221209130741655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130741655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130741656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130741656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130741657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130741657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130741657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:43.369765 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8442): Process ended prematurely: osmo-stp_10.42.42.5(pid=8442) [trial-2360↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8442)] [trial-2360↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 13:07:43.379024 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:07:43.405464 run osmo-hlr_10.42.42.2(pid=8439): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8439)] 13:07:43.453913 run osmo-hlr_10.42.42.2(pid=8439): stdout: | (launched: 2022-12-09_13:07:40.509411) 13:07:43.503828 run osmo-hlr_10.42.42.2(pid=8439): stderr: | 20221209130740686 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130740686 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130740686 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130740686 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130740686 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130740686 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130740699 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130740709 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130740709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130740709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:43.573781 run osmo-msc_10.42.42.6(pid=8445): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8445)] 13:07:43.622091 run osmo-msc_10.42.42.6(pid=8445): stdout: | (launched: 2022-12-09_13:07:42.474152) 13:07:43.672221 run osmo-msc_10.42.42.6(pid=8445): stderr: | 20221209130742749 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130742749 DLGLOBAL DEBUG validating counter group 0x7fe90255dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130742749 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130742749 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130742750 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130742750 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130742751 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130742752 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130742752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130742752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:07:43.722769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8438): Terminating (SIGTERM) 13:07:43.763842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8441): Terminating (SIGTERM) 13:07:43.804713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8444): Terminating (SIGTERM) 13:07:43.845918 --- ParallelTerminationStrategy: PID 8438 died... 13:07:43.865532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8438): Terminated: ok {rc=0} 13:07:43.910676 --- ParallelTerminationStrategy: PID 8441 died... 13:07:43.929596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8441): Terminated: ok {rc=0} 13:07:43.974403 --- ParallelTerminationStrategy: PID 8444 died... 13:07:43.993589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8444): Terminated: ok {rc=0} 13:07:44.078548 bus /sierra_3: Setting Powered False 13:07:45.178648 bus /sierra_3: Setting Powered False 13:07:46.302018 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 13:07:47.453751 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:07:47.466222 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:07:47.522255 tst mo_mt_call_osmux.py: using LAC 21669 13:07:47.653651 tst mo_mt_call_osmux.py: using RAC 249 13:07:47.782339 tst mo_mt_call_osmux.py: using CellId 21669 13:07:47.911464 tst mo_mt_call_osmux.py: using BVCI 21670 13:07:48.031890 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:07:48.043985 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:07:48.055773 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:07:48.069382 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:07:48.081233 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:07:48.093542 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:07:48.212707 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:07:48.333887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:48.817740 run create_hlr_db(pid=8447): Launched 13:07:48.945203 bus /sierra_2: Setting Powered False 13:07:50.006121 run create_hlr_db(pid=8447): Terminated: ok {rc=0} 13:07:50.438142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8449): Launched 13:07:50.749257 run osmo-hlr_10.42.42.2(pid=8450): Launched 13:07:50.866113 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:51.409180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8452): Launched 13:07:51.717987 run osmo-stp_10.42.42.5(pid=8453): Launched 13:07:51.837557 run osmo-msc_10.42.42.6: Starting osmo-msc 13:07:52.397689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8455): Launched 13:07:52.708203 run osmo-msc_10.42.42.6(pid=8456): Launched 13:07:52.881566 run osmo-stp_10.42.42.5(pid=8453): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8453)] 13:07:53.012462 run osmo-stp_10.42.42.5(pid=8453): stdout: | (launched: 2022-12-09_13:07:51.661106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:53.143121 run osmo-stp_10.42.42.5(pid=8453): stderr: | 20221209130751832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130751833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130751833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130751833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130751834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130751834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130751834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:53.271610 run osmo-stp_10.42.42.5(pid=8453): stdout: | (launched: 2022-12-09_13:07:51.661106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:53.394913 run osmo-stp_10.42.42.5(pid=8453): stderr: | 20221209130751832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130751833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130751833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130751833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130751834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130751834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130751834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:53.541991 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8453): Process ended prematurely: osmo-stp_10.42.42.5(pid=8453) [trial-2360↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8453)] [trial-2360↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 13:07:53.550833 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:07:53.577183 run osmo-hlr_10.42.42.2(pid=8450): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8450)] 13:07:53.625059 run osmo-hlr_10.42.42.2(pid=8450): stdout: | (launched: 2022-12-09_13:07:50.690425) 13:07:53.674534 run osmo-hlr_10.42.42.2(pid=8450): stderr: | 20221209130750871 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130750871 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130750871 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130750871 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130750871 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130750871 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130750883 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130750894 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130750894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130750894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:53.743476 run osmo-msc_10.42.42.6(pid=8456): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8456)] 13:07:53.791152 run osmo-msc_10.42.42.6(pid=8456): stdout: | (launched: 2022-12-09_13:07:52.650251) 13:07:53.840455 run osmo-msc_10.42.42.6(pid=8456): stderr: | 20221209130752927 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130752927 DLGLOBAL DEBUG validating counter group 0x7f093963bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130752928 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130752928 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130752928 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130752928 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130752930 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130752930 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130752930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130752930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:07:53.889879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8449): Terminating (SIGTERM) 13:07:53.929560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8452): Terminating (SIGTERM) 13:07:53.969234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8455): Terminating (SIGTERM) 13:07:54.009740 --- ParallelTerminationStrategy: PID 8449 died... 13:07:54.028899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8449): Terminated: ok {rc=0} 13:07:54.073105 --- ParallelTerminationStrategy: PID 8452 died... 13:07:54.091912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8452): Terminated: ok {rc=0} 13:07:54.135669 --- ParallelTerminationStrategy: PID 8455 died... 13:07:54.154395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8455): Terminated: ok {rc=0} 13:07:54.240449 bus /sierra_3: Setting Powered False 13:07:55.341170 bus /sierra_3: Setting Powered False 13:07:56.457694 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 emergency:trx-b200 --------------------------------------------------------------------- 13:07:57.712664 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:07:57.716878 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 13:07:57.751271 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 13:07:57.778475 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 13:07:57.863176 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 13:07:57.896217 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 13:07:57.923004 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 13:07:58.506745 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2360 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 13:07:58.511804 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:07:58.522544 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 13:07:58.572743 tst emergency_mo_mt_call.py: using LAC 21670 13:07:58.693737 tst emergency_mo_mt_call.py: using RAC 250 13:07:58.819994 tst emergency_mo_mt_call.py: using CellId 21670 13:07:58.940709 tst emergency_mo_mt_call.py: using BVCI 21671 13:07:59.051248 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:07:59.062101 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:07:59.072471 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:07:59.083702 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:07:59.094747 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:07:59.105691 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:07:59.226836 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:07:59.344380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:59.817466 run create_hlr_db(pid=8461): Launched 13:07:59.941809 bus /sierra_2: Setting Powered False 13:08:01.019274 run create_hlr_db(pid=8461): Terminated: ok {rc=0} 13:08:01.559941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8463): Launched 13:08:01.919759 run osmo-hlr_10.42.42.2(pid=8475): Launched 13:08:02.192199 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:02.922926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8515): Launched 13:08:03.318102 run osmo-stp_10.42.42.5(pid=8546): Launched 13:08:03.620175 tst emergency_mo_mt_call.py: using MSISDN 7226 13:08:03.929286 run osmo-msc_10.42.42.6: Starting osmo-msc 13:08:04.649504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8734): Launched 13:08:05.014907 run osmo-msc_10.42.42.6(pid=8739): Launched 13:08:05.358048 run osmo-stp_10.42.42.5(pid=8546): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8546)] 13:08:05.633290 run osmo-stp_10.42.42.5(pid=8546): stdout: | (launched: 2022-12-09_13:08:03.247951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:05.909577 run osmo-stp_10.42.42.5(pid=8546): stderr: | 20221209130803582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130803582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130803582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130803583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130803583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130803583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130803583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:06.068360 run osmo-stp_10.42.42.5(pid=8546): stdout: | (launched: 2022-12-09_13:08:03.247951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:06.191197 run osmo-stp_10.42.42.5(pid=8546): stderr: | 20221209130803582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130803582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130803582 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130803583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130803583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130803583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130803583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:06.338683 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=8546): Process ended prematurely: osmo-stp_10.42.42.5(pid=8546) [trial-2360↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8546)] [trial-2360↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 13:08:06.348099 tst emergency_mo_mt_call.py:19: Test FAILED (7.8 sec) 13:08:06.376729 run osmo-hlr_10.42.42.2(pid=8475): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8475)] 13:08:06.426905 run osmo-hlr_10.42.42.2(pid=8475): stdout: | (launched: 2022-12-09_13:08:01.852928) 13:08:06.478557 run osmo-hlr_10.42.42.2(pid=8475): stderr: | 20221209130802197 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130802197 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130802197 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130802197 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130802197 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130802197 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130802213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130802221 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130802222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130802222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:06.550266 run osmo-msc_10.42.42.6(pid=8739): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8739)] 13:08:06.600276 run osmo-msc_10.42.42.6(pid=8739): stdout: | (launched: 2022-12-09_13:08:04.951282) 13:08:06.651558 run osmo-msc_10.42.42.6(pid=8739): stderr: | 20221209130805536 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130805536 DLGLOBAL DEBUG validating counter group 0x7fc37d795c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130805536 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130805536 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130805541 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130805542 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130805543 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130805544 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130805544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130805544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:08:06.702472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8463): Terminating (SIGTERM) 13:08:06.743652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8515): Terminating (SIGTERM) 13:08:06.787224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8734): Terminating (SIGTERM) 13:08:06.831426 --- ParallelTerminationStrategy: PID 8463 died... 13:08:06.851564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8463): Terminated: ok {rc=0} 13:08:06.899151 --- ParallelTerminationStrategy: PID 8515 died... 13:08:06.918862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8515): Terminated: ok {rc=0} 13:08:06.964190 --- ParallelTerminationStrategy: PID 8734 died... 13:08:06.983567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8734): Terminated: ok {rc=0} 13:08:07.071364 bus /sierra_3: Setting Powered False 13:08:08.173235 bus /sierra_3: Setting Powered False 13:08:09.291227 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 13:08:10.386364 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:08:10.399604 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 13:08:10.456393 tst emergency_preemptive_call.py: using LAC 21671 13:08:10.577673 tst emergency_preemptive_call.py: using RAC 251 13:08:10.700843 tst emergency_preemptive_call.py: using CellId 21671 13:08:10.822485 tst emergency_preemptive_call.py: using BVCI 21672 13:08:10.937832 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:08:10.949904 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:08:10.961519 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:08:10.973204 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:08:10.984734 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:08:10.996659 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:08:11.117333 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:08:11.236744 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:08:11.356503 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:08:11.474807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:11.960794 run create_hlr_db(pid=8743): Launched 13:08:12.123120 bus /sierra_2: Setting Powered False 13:08:13.186063 run create_hlr_db(pid=8743): Terminated: ok {rc=0} 13:08:13.628619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8745): Launched 13:08:13.957810 run osmo-hlr_10.42.42.2(pid=8746): Launched 13:08:14.194760 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:14.828599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8748): Launched 13:08:15.160447 run osmo-stp_10.42.42.5(pid=8749): Launched 13:08:15.416171 tst emergency_preemptive_call.py: using MSISDN 7227 13:08:15.710205 run osmo-msc_10.42.42.6: Starting osmo-msc 13:08:16.354510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8751): Launched 13:08:16.741881 run osmo-msc_10.42.42.6(pid=8752): Launched 13:08:16.966170 run osmo-stp_10.42.42.5(pid=8749): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8749)] 13:08:17.184607 run osmo-stp_10.42.42.5(pid=8749): stdout: | (launched: 2022-12-09_13:08:15.102398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:17.500326 run osmo-stp_10.42.42.5(pid=8749): stderr: | 20221209130815428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130815428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130815428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130815429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130815429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130815429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130815429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:17.663204 run osmo-stp_10.42.42.5(pid=8749): stdout: | (launched: 2022-12-09_13:08:15.102398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:17.795809 run osmo-stp_10.42.42.5(pid=8749): stderr: | 20221209130815428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130815428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130815428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130815429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130815429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130815429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130815429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:17.954007 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=8749): Process ended prematurely: osmo-stp_10.42.42.5(pid=8749) [trial-2360↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8749)] [trial-2360↪emergency:trx-b200↪emergency_preemptive_call.py:32] 13:08:17.963759 tst emergency_preemptive_call.py:32: Test FAILED (7.6 sec) 13:08:17.993740 run osmo-hlr_10.42.42.2(pid=8746): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8746)] 13:08:18.046702 run osmo-hlr_10.42.42.2(pid=8746): stdout: | (launched: 2022-12-09_13:08:13.899425) 13:08:18.101295 run osmo-hlr_10.42.42.2(pid=8746): stderr: | 20221209130814233 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130814233 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130814233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130814233 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130814233 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130814233 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130814255 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130814268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130814273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130814273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:18.177187 run osmo-msc_10.42.42.6(pid=8752): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8752)] 13:08:18.230075 run osmo-msc_10.42.42.6(pid=8752): stdout: | (launched: 2022-12-09_13:08:16.671215) 13:08:18.284355 run osmo-msc_10.42.42.6(pid=8752): stderr: | 20221209130817211 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209130817211 DLGLOBAL DEBUG validating counter group 0x7f90d46e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209130817211 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209130817212 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209130817212 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209130817212 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209130817217 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209130817217 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209130817218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209130817218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:08:18.338983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8745): Terminating (SIGTERM) 13:08:18.383218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8748): Terminating (SIGTERM) 13:08:18.428006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8751): Terminating (SIGTERM) 13:08:18.474691 --- ParallelTerminationStrategy: PID 8745 died... 13:08:18.495390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8745): Terminated: ok {rc=0} 13:08:18.546255 --- ParallelTerminationStrategy: PID 8748 died... 13:08:18.567026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8748): Terminated: ok {rc=0} 13:08:18.616324 --- ParallelTerminationStrategy: PID 8751 died... 13:08:18.637392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8751): Terminated: ok {rc=0} 13:08:18.745106 bus /sierra_9: Setting Powered False 13:08:19.877764 bus /sierra_9: Setting Powered False 13:08:20.998573 bus /sierra_8: Setting Powered False 13:08:22.100393 bus /sierra_8: Setting Powered False 13:08:23.220840 bus /sierra_3: Setting Powered False 13:08:24.322675 bus /sierra_3: Setting Powered False 13:08:25.443678 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-b200 --------------------------------------------------------------------- 13:08:26.725741 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:08:26.730013 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 13:08:26.762928 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 13:08:26.801466 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 13:08:26.890093 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 13:08:26.923386 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 13:08:26.961535 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 13:08:27.550506 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 13:08:27.600749 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:27.611464 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:08:27.660205 tst cs_paging_gprs_active.py: using LAC 21672 13:08:27.796104 tst cs_paging_gprs_active.py: using RAC 252 13:08:27.925779 tst cs_paging_gprs_active.py: using CellId 21672 13:08:28.055866 tst cs_paging_gprs_active.py: using BVCI 21673 13:08:28.170061 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:28.180748 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:28.191248 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:28.201778 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:28.212047 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:28.222413 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:28.232859 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:28.243186 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:28.253778 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:08:28.373126 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:08:28.491421 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:08:28.703642 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:29.016706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8758): Launched 13:08:29.288662 run iperf3-srv_10.42.42.10(pid=8759): Launched 13:08:29.405580 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:08:29.614029 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:29.927258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8760): Launched 13:08:30.198314 run iperf3-srv_10.42.42.10(pid=8761): Launched 13:08:30.317885 tst cs_paging_gprs_active.py:38: start network... 13:08:30.527633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:31.038990 run create_hlr_db(pid=8762): Launched 13:08:31.207041 bus /sierra_2: Setting Powered False 13:08:32.274818 run create_hlr_db(pid=8762): Terminated: ok {rc=0} 13:08:32.721056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8764): Launched 13:08:33.032514 run osmo-hlr_10.42.42.2(pid=8765): Launched 13:08:33.151615 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:33.692729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8767): Launched 13:08:34.004110 run osmo-stp_10.42.42.5(pid=8768): Launched 13:08:34.122486 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:34.661116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8770): Launched 13:08:34.780315 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:08:35.044003 run patchelf(pid=8771): Launched 13:08:35.217122 run osmo-stp_10.42.42.5(pid=8768): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8768)] 13:08:35.349435 run osmo-stp_10.42.42.5(pid=8768): stdout: | (launched: 2022-12-09_13:08:33.946448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:35.482925 run osmo-stp_10.42.42.5(pid=8768): stderr: | 20221209130834117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130834118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130834118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130834118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130834119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130834119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130834119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:35.615951 run osmo-stp_10.42.42.5(pid=8768): stdout: | (launched: 2022-12-09_13:08:33.946448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:35.743855 run osmo-stp_10.42.42.5(pid=8768): stderr: | 20221209130834117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130834118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130834118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130834118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130834119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130834119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130834119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:35.895387 run patchelf(pid=8771): Terminating (SIGINT) 13:08:36.068822 run patchelf(pid=8771): Terminated: ok {rc=0} 13:08:36.194433 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8768): Process ended prematurely: osmo-stp_10.42.42.5(pid=8768) [trial-2360↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8768)] [trial-2360↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 13:08:36.203911 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 13:08:36.231391 run osmo-hlr_10.42.42.2(pid=8765): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8765)] 13:08:36.280124 run osmo-hlr_10.42.42.2(pid=8765): stdout: | (launched: 2022-12-09_13:08:32.975284) 13:08:36.330530 run osmo-hlr_10.42.42.2(pid=8765): stderr: | 20221209130833152 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130833152 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130833152 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130833152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130833152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130833152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130833165 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130833174 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130833174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130833174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:36.381348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8758): Terminating (SIGTERM) 13:08:36.422491 run iperf3-srv_10.42.42.10(pid=8759): Terminating (SIGTERM) 13:08:36.463608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8760): Terminating (SIGTERM) 13:08:36.504731 run iperf3-srv_10.42.42.10(pid=8761): Terminating (SIGTERM) 13:08:36.545666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8764): Terminating (SIGTERM) 13:08:36.586956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8767): Terminating (SIGTERM) 13:08:36.635905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8770): Terminating (SIGTERM) 13:08:36.707402 --- ParallelTerminationStrategy: PID 8758 died... 13:08:36.728453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8758): Terminated: ok {rc=0} 13:08:36.778945 --- ParallelTerminationStrategy: PID 8759 died... 13:08:36.799848 run iperf3-srv_10.42.42.10(pid=8759): Terminated {rc=256} 13:08:36.848166 --- ParallelTerminationStrategy: PID 8760 died... 13:08:36.868853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8760): Terminated: ok {rc=0} 13:08:36.915980 --- ParallelTerminationStrategy: PID 8761 died... 13:08:36.935869 run iperf3-srv_10.42.42.10(pid=8761): Terminated {rc=256} 13:08:36.983505 --- ParallelTerminationStrategy: PID 8764 died... 13:08:37.003466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8764): Terminated: ok {rc=0} 13:08:37.051260 --- ParallelTerminationStrategy: PID 8767 died... 13:08:37.071177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8767): Terminated: ok {rc=0} 13:08:37.118734 --- ParallelTerminationStrategy: PID 8770 died... 13:08:37.138876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8770): Terminated: ok {rc=0} 13:08:37.228914 bus /gobi_0: Setting Powered False 13:08:38.329799 bus /gobi_0: Setting Powered False 13:08:39.445401 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200 iperf3.py ---------------------------------------------- 13:08:40.597207 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:40.609214 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:08:40.663323 tst iperf3.py: using LAC 21673 13:08:40.794308 tst iperf3.py: using RAC 253 13:08:40.925040 tst iperf3.py: using CellId 21673 13:08:41.056020 tst iperf3.py: using BVCI 21674 13:08:41.176235 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:41.187458 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:41.198587 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:41.209870 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:41.220849 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:41.232005 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:41.243269 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:41.254746 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:41.266109 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:08:41.387052 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:08:41.610182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:41.943364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8773): Launched 13:08:42.232000 run iperf3-srv_10.42.42.10(pid=8774): Launched 13:08:42.356379 tst iperf3.py:8: start network... 13:08:42.579504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:43.094017 run create_hlr_db(pid=8775): Launched 13:08:43.219331 bus /gobi_6: Setting Powered False 13:08:44.283907 run create_hlr_db(pid=8775): Terminated: ok {rc=0} 13:08:44.726477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8777): Launched 13:08:45.039487 run osmo-hlr_10.42.42.2(pid=8778): Launched 13:08:45.158106 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:45.696224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8780): Launched 13:08:46.031974 run osmo-stp_10.42.42.5(pid=8781): Launched 13:08:46.322301 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:46.949712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8783): Launched 13:08:47.090583 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:08:47.375512 run patchelf(pid=8784): Launched 13:08:47.561751 run osmo-stp_10.42.42.5(pid=8781): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8781)] 13:08:47.702766 run osmo-stp_10.42.42.5(pid=8781): stdout: | (launched: 2022-12-09_13:08:45.971839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:47.844785 run osmo-stp_10.42.42.5(pid=8781): stderr: | 20221209130846223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130846223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130846224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130846224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130846225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130846225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130846225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:47.986699 run osmo-stp_10.42.42.5(pid=8781): stdout: | (launched: 2022-12-09_13:08:45.971839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:48.122927 run osmo-stp_10.42.42.5(pid=8781): stderr: | 20221209130846223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130846223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130846224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130846224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130846225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130846225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130846225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:48.284273 run patchelf(pid=8784): Terminating (SIGINT) 13:08:48.469312 run patchelf(pid=8784): Terminated: ok {rc=0} 13:08:48.602565 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8781): Process ended prematurely: osmo-stp_10.42.42.5(pid=8781) [trial-2360↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8781)] [trial-2360↪gprs:trx-b200↪iperf3.py:8] 13:08:48.612833 tst iperf3.py:8: Test FAILED (8.1 sec) 13:08:48.642243 run osmo-hlr_10.42.42.2(pid=8778): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8778)] 13:08:48.693363 run osmo-hlr_10.42.42.2(pid=8778): stdout: | (launched: 2022-12-09_13:08:44.982322) 13:08:48.746184 run osmo-hlr_10.42.42.2(pid=8778): stderr: | 20221209130845158 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130845158 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130845159 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130845159 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130845159 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130845159 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130845171 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130845179 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130845180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130845180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:48.799207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8773): Terminating (SIGTERM) 13:08:48.842059 run iperf3-srv_10.42.42.10(pid=8774): Terminating (SIGTERM) 13:08:48.884856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8777): Terminating (SIGTERM) 13:08:48.927617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8780): Terminating (SIGTERM) 13:08:48.970279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8783): Terminating (SIGTERM) 13:08:49.013080 --- ParallelTerminationStrategy: PID 8773 died... 13:08:49.033403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8773): Terminated: ok {rc=0} 13:08:49.080617 --- ParallelTerminationStrategy: PID 8774 died... 13:08:49.101102 run iperf3-srv_10.42.42.10(pid=8774): Terminated {rc=256} 13:08:49.148518 --- ParallelTerminationStrategy: PID 8777 died... 13:08:49.168520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8777): Terminated: ok {rc=0} 13:08:49.215912 --- ParallelTerminationStrategy: PID 8780 died... 13:08:49.235861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8780): Terminated: ok {rc=0} 13:08:49.283249 --- ParallelTerminationStrategy: PID 8783 died... 13:08:49.303209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8783): Terminated: ok {rc=0} 13:08:49.393475 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 13:08:50.548569 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:50.560575 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:08:50.610994 tst iperf3m4.py: using LAC 21674 13:08:50.744209 tst iperf3m4.py: using RAC 254 13:08:50.875101 tst iperf3m4.py: using CellId 21674 13:08:51.006299 tst iperf3m4.py: using BVCI 21675 13:08:51.126490 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:51.137754 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:51.148690 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:51.160030 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:51.171235 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:51.182393 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:51.193698 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:51.204821 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:08:51.216262 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:08:51.336167 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:08:51.461031 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:08:51.583074 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:08:51.704758 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:08:51.927949 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:52.260820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8785): Launched 13:08:52.550946 run iperf3-srv_10.42.42.10(pid=8786): Launched 13:08:52.677745 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:08:52.901497 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:53.237135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8787): Launched 13:08:53.525403 run iperf3-srv_10.42.42.10(pid=8788): Launched 13:08:53.650041 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:08:53.873375 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:54.206422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8789): Launched 13:08:54.494208 run iperf3-srv_10.42.42.10(pid=8790): Launched 13:08:54.618507 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:08:54.841682 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:55.173374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8791): Launched 13:08:55.462686 run iperf3-srv_10.42.42.10(pid=8792): Launched 13:08:55.588746 tst iperf3m4.py:8: start network... 13:08:55.812255 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:56.326568 run create_hlr_db(pid=8793): Launched 13:08:56.455108 bus /gobi_6: Setting Powered False 13:08:57.520314 run create_hlr_db(pid=8793): Terminated: ok {rc=0} 13:08:57.963161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8795): Launched 13:08:58.276279 run osmo-hlr_10.42.42.2(pid=8796): Launched 13:08:58.395008 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:58.945056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8798): Launched 13:08:59.256691 run osmo-stp_10.42.42.5(pid=8799): Launched 13:08:59.376272 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:59.911275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8801): Launched 13:09:00.030006 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:00.293483 run patchelf(pid=8802): Launched 13:09:00.466323 run osmo-stp_10.42.42.5(pid=8799): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8799)] 13:09:00.598169 run osmo-stp_10.42.42.5(pid=8799): stdout: | (launched: 2022-12-09_13:08:59.198916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:00.731025 run osmo-stp_10.42.42.5(pid=8799): stderr: | 20221209130859368 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130859368 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130859369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130859369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130859369 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130859370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130859370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:00.871275 run osmo-stp_10.42.42.5(pid=8799): stdout: | (launched: 2022-12-09_13:08:59.198916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:01.022642 run osmo-stp_10.42.42.5(pid=8799): stderr: | 20221209130859368 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130859368 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130859369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130859369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130859369 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130859370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130859370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:01.227204 run patchelf(pid=8802): Terminating (SIGINT) 13:09:01.429399 run patchelf(pid=8802): Terminated: ok {rc=0} 13:09:01.566758 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8799): Process ended prematurely: osmo-stp_10.42.42.5(pid=8799) [trial-2360↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8799)] [trial-2360↪gprs:trx-b200↪iperf3m4.py:8] 13:09:01.578011 tst iperf3m4.py:8: Test FAILED (11.1 sec) 13:09:01.610976 run osmo-hlr_10.42.42.2(pid=8796): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8796)] 13:09:01.665323 run osmo-hlr_10.42.42.2(pid=8796): stdout: | (launched: 2022-12-09_13:08:58.218796) 13:09:01.720342 run osmo-hlr_10.42.42.2(pid=8796): stderr: | 20221209130858393 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130858393 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130858393 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130858393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130858393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130858393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130858405 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130858414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130858414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130858414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:01.776458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8785): Terminating (SIGTERM) 13:09:01.822612 run iperf3-srv_10.42.42.10(pid=8786): Terminating (SIGTERM) 13:09:01.868680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8787): Terminating (SIGTERM) 13:09:01.913493 run iperf3-srv_10.42.42.10(pid=8788): Terminating (SIGTERM) 13:09:01.959658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8789): Terminating (SIGTERM) 13:09:02.006042 run iperf3-srv_10.42.42.10(pid=8790): Terminating (SIGTERM) 13:09:02.054422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8791): Terminating (SIGTERM) 13:09:02.099906 run iperf3-srv_10.42.42.10(pid=8792): Terminating (SIGTERM) 13:09:02.144328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8795): Terminating (SIGTERM) 13:09:02.189351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8798): Terminating (SIGTERM) 13:09:02.235320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8801): Terminating (SIGTERM) 13:09:02.279160 --- ParallelTerminationStrategy: PID 8785 died... 13:09:02.299739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8785): Terminated: ok {rc=0} 13:09:02.347651 --- ParallelTerminationStrategy: PID 8786 died... 13:09:02.367658 run iperf3-srv_10.42.42.10(pid=8786): Terminated {rc=256} 13:09:02.415503 --- ParallelTerminationStrategy: PID 8787 died... 13:09:02.435402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8787): Terminated: ok {rc=0} 13:09:02.482900 --- ParallelTerminationStrategy: PID 8788 died... 13:09:02.502909 run iperf3-srv_10.42.42.10(pid=8788): Terminated {rc=256} 13:09:02.550380 --- ParallelTerminationStrategy: PID 8789 died... 13:09:02.570350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8789): Terminated: ok {rc=0} 13:09:02.617809 --- ParallelTerminationStrategy: PID 8790 died... 13:09:02.637746 run iperf3-srv_10.42.42.10(pid=8790): Terminated {rc=256} 13:09:02.685519 --- ParallelTerminationStrategy: PID 8791 died... 13:09:02.705553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8791): Terminated: ok {rc=0} 13:09:02.753195 --- ParallelTerminationStrategy: PID 8792 died... 13:09:02.773116 run iperf3-srv_10.42.42.10(pid=8792): Terminated {rc=256} 13:09:02.820854 --- ParallelTerminationStrategy: PID 8795 died... 13:09:02.841392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8795): Terminated: ok {rc=0} 13:09:02.888720 --- ParallelTerminationStrategy: PID 8798 died... 13:09:02.908720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8798): Terminated: ok {rc=0} 13:09:02.956187 --- ParallelTerminationStrategy: PID 8801 died... 13:09:02.976184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8801): Terminated: ok {rc=0} 13:09:03.066500 bus /gobi_4: Setting Powered False 13:09:04.167454 bus /gobi_4: Setting Powered False 13:09:05.285743 bus /gobi_1: Setting Powered False 13:09:06.386171 bus /gobi_1: Setting Powered False 13:09:07.503445 bus /gobi_0: Setting Powered False 13:09:08.603248 bus /gobi_0: Setting Powered False 13:09:09.721847 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200 ping.py ---------------------------------------------- 13:09:10.825653 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:09:10.837539 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:09:10.888181 tst ping.py: using LAC 21675 13:09:11.015508 tst ping.py: using RAC 255 13:09:11.142992 tst ping.py: using CellId 21675 13:09:11.271236 tst ping.py: using BVCI 21676 13:09:11.389492 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:09:11.400717 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:09:11.411863 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:09:11.423127 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:09:11.434451 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:09:11.445697 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:09:11.457151 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:09:11.468371 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:09:11.584378 tst ping.py:19: start network... 13:09:11.787646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:12.258379 run create_hlr_db(pid=8803): Launched 13:09:12.383081 bus /gobi_6: Setting Powered False 13:09:13.444019 run create_hlr_db(pid=8803): Terminated: ok {rc=0} 13:09:13.888419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8805): Launched 13:09:14.214212 run osmo-hlr_10.42.42.2(pid=8806): Launched 13:09:14.339280 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:14.901329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8808): Launched 13:09:15.227189 run osmo-stp_10.42.42.5(pid=8809): Launched 13:09:15.351981 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:15.929734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8811): Launched 13:09:16.059212 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:16.342541 run patchelf(pid=8812): Launched 13:09:16.539691 run osmo-stp_10.42.42.5(pid=8809): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8809)] 13:09:16.682209 run osmo-stp_10.42.42.5(pid=8809): stdout: | (launched: 2022-12-09_13:09:15.167304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:16.825321 run osmo-stp_10.42.42.5(pid=8809): stderr: | 20221209130915359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130915359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130915359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130915360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130915360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130915360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130915360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:16.968872 run osmo-stp_10.42.42.5(pid=8809): stdout: | (launched: 2022-12-09_13:09:15.167304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:17.105481 run osmo-stp_10.42.42.5(pid=8809): stderr: | 20221209130915359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130915359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130915359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130915360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130915360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130915360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130915360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:17.267615 run patchelf(pid=8812): Terminating (SIGINT) 13:09:17.450339 run patchelf(pid=8812): Terminated: ok {rc=0} 13:09:17.581367 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8809): Process ended prematurely: osmo-stp_10.42.42.5(pid=8809) [trial-2360↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8809)] [trial-2360↪gprs:trx-b200↪ping.py:22] 13:09:17.591150 tst ping.py:22: Test FAILED (6.8 sec) 13:09:17.620422 run osmo-hlr_10.42.42.2(pid=8806): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8806)] 13:09:17.671978 run osmo-hlr_10.42.42.2(pid=8806): stdout: | (launched: 2022-12-09_13:09:14.154408) 13:09:17.724891 run osmo-hlr_10.42.42.2(pid=8806): stderr: | 20221209130914353 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130914353 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130914353 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130914353 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130914353 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130914353 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130914364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130914374 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130914375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130914375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:17.778343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8805): Terminating (SIGTERM) 13:09:17.821251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8808): Terminating (SIGTERM) 13:09:17.864627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8811): Terminating (SIGTERM) 13:09:17.908514 --- ParallelTerminationStrategy: PID 8805 died... 13:09:17.929096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8805): Terminated: ok {rc=0} 13:09:17.977110 --- ParallelTerminationStrategy: PID 8808 died... 13:09:17.997408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8808): Terminated: ok {rc=0} 13:09:18.045118 --- ParallelTerminationStrategy: PID 8811 died... 13:09:18.065201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8811): Terminated: ok {rc=0} 13:09:18.155146 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 13:09:19.244610 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:09:19.256880 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:09:19.308931 tst ping_idle_ping.py: using LAC 21676 13:09:19.440340 tst ping_idle_ping.py: using RAC 1 13:09:19.567473 tst ping_idle_ping.py: using CellId 21676 13:09:19.689235 tst ping_idle_ping.py: using BVCI 21677 13:09:19.801230 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:09:19.812050 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:09:19.822968 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:09:19.834112 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:09:19.845334 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:09:19.856394 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:09:19.867740 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:09:19.878795 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:09:19.998476 tst ping_idle_ping.py:24: start network... 13:09:20.218258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:20.725563 run create_hlr_db(pid=8813): Launched 13:09:20.851182 bus /gobi_6: Setting Powered False 13:09:21.915446 run create_hlr_db(pid=8813): Terminated: ok {rc=0} 13:09:22.351816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8815): Launched 13:09:22.658007 run osmo-hlr_10.42.42.2(pid=8816): Launched 13:09:22.774794 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:23.309368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8818): Launched 13:09:23.615740 run osmo-stp_10.42.42.5(pid=8819): Launched 13:09:23.731295 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:24.258196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8821): Launched 13:09:24.374661 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:24.634009 run patchelf(pid=8822): Launched 13:09:24.804397 run osmo-stp_10.42.42.5(pid=8819): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8819)] 13:09:24.934375 run osmo-stp_10.42.42.5(pid=8819): stdout: | (launched: 2022-12-09_13:09:23.558788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:25.066089 run osmo-stp_10.42.42.5(pid=8819): stderr: | 20221209130923731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130923731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130923732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130923732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130923732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130923733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130923733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:25.196852 run osmo-stp_10.42.42.5(pid=8819): stdout: | (launched: 2022-12-09_13:09:23.558788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:25.322293 run osmo-stp_10.42.42.5(pid=8819): stderr: | 20221209130923731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130923731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130923732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130923732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130923732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130923733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130923733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:25.470896 run patchelf(pid=8822): Terminating (SIGINT) 13:09:25.641397 run patchelf(pid=8822): Terminated: ok {rc=0} 13:09:25.764513 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8819): Process ended prematurely: osmo-stp_10.42.42.5(pid=8819) [trial-2360↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8819)] [trial-2360↪gprs:trx-b200↪ping_idle_ping.py:27] 13:09:25.773520 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:09:25.800666 run osmo-hlr_10.42.42.2(pid=8816): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8816)] 13:09:25.849236 run osmo-hlr_10.42.42.2(pid=8816): stdout: | (launched: 2022-12-09_13:09:22.601210) 13:09:25.899463 run osmo-hlr_10.42.42.2(pid=8816): stderr: | 20221209130922777 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130922777 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130922777 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130922777 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130922777 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130922778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130922790 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130922799 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130922800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130922800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:25.950246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8815): Terminating (SIGTERM) 13:09:25.991204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8818): Terminating (SIGTERM) 13:09:26.031731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8821): Terminating (SIGTERM) 13:09:26.072698 --- ParallelTerminationStrategy: PID 8815 died... 13:09:26.092196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8815): Terminated: ok {rc=0} 13:09:26.137062 --- ParallelTerminationStrategy: PID 8818 died... 13:09:26.156066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8818): Terminated: ok {rc=0} 13:09:26.200488 --- ParallelTerminationStrategy: PID 8821 died... 13:09:26.219338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8821): Terminated: ok {rc=0} 13:09:26.304076 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 13:09:27.622311 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:09:27.629887 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:09:27.666643 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:09:27.706929 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:09:27.806338 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:09:27.841404 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:09:27.881329 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:09:28.469167 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:09:28.523846 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:28.535185 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:09:28.585743 tst cs_paging_gprs_active.py: using LAC 21677 13:09:28.716652 tst cs_paging_gprs_active.py: using RAC 2 13:09:28.844920 tst cs_paging_gprs_active.py: using CellId 21677 13:09:28.973383 tst cs_paging_gprs_active.py: using BVCI 21678 13:09:29.094648 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:29.106194 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:29.117385 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:29.128728 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:29.139975 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:29.151256 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:29.162838 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:29.174130 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:29.185724 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:09:29.302210 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:09:29.420913 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:09:29.630794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:29.943358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8826): Launched 13:09:30.214543 run iperf3-srv_10.42.42.10(pid=8827): Launched 13:09:30.332589 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:09:30.541297 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:30.863704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8828): Launched 13:09:31.187227 run iperf3-srv_10.42.42.10(pid=8829): Launched 13:09:31.323697 tst cs_paging_gprs_active.py:38: start network... 13:09:31.535649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:32.026519 run create_hlr_db(pid=8830): Launched 13:09:32.190389 bus /gobi_6: Setting Powered False 13:09:33.252403 run create_hlr_db(pid=8830): Terminated: ok {rc=0} 13:09:33.684591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8832): Launched 13:09:33.995456 run osmo-hlr_10.42.42.2(pid=8833): Launched 13:09:34.114101 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:34.650703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8835): Launched 13:09:34.964244 run osmo-stp_10.42.42.5(pid=8836): Launched 13:09:35.083929 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:35.621144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8838): Launched 13:09:35.740139 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:36.004138 run patchelf(pid=8839): Launched 13:09:36.177037 run osmo-stp_10.42.42.5(pid=8836): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8836)] 13:09:36.308262 run osmo-stp_10.42.42.5(pid=8836): stdout: | (launched: 2022-12-09_13:09:34.906825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:36.441841 run osmo-stp_10.42.42.5(pid=8836): stderr: | 20221209130935080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130935080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130935080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130935081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130935081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130935081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130935081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:36.575055 run osmo-stp_10.42.42.5(pid=8836): stdout: | (launched: 2022-12-09_13:09:34.906825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:36.702665 run osmo-stp_10.42.42.5(pid=8836): stderr: | 20221209130935080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130935080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130935080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130935081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130935081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130935081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130935081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:36.853796 run patchelf(pid=8839): Terminating (SIGINT) 13:09:37.026693 run patchelf(pid=8839): Terminated: ok {rc=0} 13:09:37.152684 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8836): Process ended prematurely: osmo-stp_10.42.42.5(pid=8836) [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8836)] [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:09:37.162470 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:09:37.189927 run osmo-hlr_10.42.42.2(pid=8833): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8833)] 13:09:37.238210 run osmo-hlr_10.42.42.2(pid=8833): stdout: | (launched: 2022-12-09_13:09:33.938339) 13:09:37.287773 run osmo-hlr_10.42.42.2(pid=8833): stderr: | 20221209130934117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130934117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130934117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130934117 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130934117 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130934117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130934128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130934136 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130934136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130934136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:37.337998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8826): Terminating (SIGTERM) 13:09:37.378069 run iperf3-srv_10.42.42.10(pid=8827): Terminating (SIGTERM) 13:09:37.418004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8828): Terminating (SIGTERM) 13:09:37.458056 run iperf3-srv_10.42.42.10(pid=8829): Terminating (SIGTERM) 13:09:37.498040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8832): Terminating (SIGTERM) 13:09:37.538053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8835): Terminating (SIGTERM) 13:09:37.578245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8838): Terminating (SIGTERM) 13:09:37.618480 --- ParallelTerminationStrategy: PID 8826 died... 13:09:37.637684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8826): Terminated: ok {rc=0} 13:09:37.681995 --- ParallelTerminationStrategy: PID 8827 died... 13:09:37.700499 run iperf3-srv_10.42.42.10(pid=8827): Terminated {rc=256} 13:09:37.744571 --- ParallelTerminationStrategy: PID 8828 died... 13:09:37.763458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8828): Terminated: ok {rc=0} 13:09:37.807637 --- ParallelTerminationStrategy: PID 8829 died... 13:09:37.826424 run iperf3-srv_10.42.42.10(pid=8829): Terminated {rc=256} 13:09:37.871574 --- ParallelTerminationStrategy: PID 8832 died... 13:09:37.890195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8832): Terminated: ok {rc=0} 13:09:37.934202 --- ParallelTerminationStrategy: PID 8835 died... 13:09:37.952782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8835): Terminated: ok {rc=0} 13:09:37.996551 --- ParallelTerminationStrategy: PID 8838 died... 13:09:38.015272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8838): Terminated: ok {rc=0} 13:09:38.100200 bus /gobi_0: Setting Powered False 13:09:39.201366 bus /gobi_0: Setting Powered False 13:09:40.318850 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:09:41.467262 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:41.478916 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:09:41.533319 tst iperf3.py: using LAC 21678 13:09:41.656647 tst iperf3.py: using RAC 3 13:09:41.781316 tst iperf3.py: using CellId 21678 13:09:41.905955 tst iperf3.py: using BVCI 21679 13:09:42.028211 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:42.039979 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:42.051377 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:42.063407 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:42.075848 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:42.087117 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:42.099073 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:42.110694 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:42.122782 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:09:42.239711 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:09:42.449612 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:42.761765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8841): Launched 13:09:43.033662 run iperf3-srv_10.42.42.10(pid=8842): Launched 13:09:43.151212 tst iperf3.py:8: start network... 13:09:43.359795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:43.841407 run create_hlr_db(pid=8843): Launched 13:09:43.968511 bus /gobi_6: Setting Powered False 13:09:45.029814 run create_hlr_db(pid=8843): Terminated: ok {rc=0} 13:09:45.482627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8845): Launched 13:09:45.814327 run osmo-hlr_10.42.42.2(pid=8846): Launched 13:09:46.037279 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:46.694118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8848): Launched 13:09:47.089745 run osmo-stp_10.42.42.5(pid=8849): Launched 13:09:47.338516 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:47.888478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8851): Launched 13:09:48.006686 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:48.269219 run patchelf(pid=8852): Launched 13:09:48.443028 run osmo-stp_10.42.42.5(pid=8849): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8849)] 13:09:48.574705 run osmo-stp_10.42.42.5(pid=8849): stdout: | (launched: 2022-12-09_13:09:47.026652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:48.707251 run osmo-stp_10.42.42.5(pid=8849): stderr: | 20221209130947318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130947318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130947318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130947318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130947319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130947319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130947319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:48.839966 run osmo-stp_10.42.42.5(pid=8849): stdout: | (launched: 2022-12-09_13:09:47.026652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:48.966883 run osmo-stp_10.42.42.5(pid=8849): stderr: | 20221209130947318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130947318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130947318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130947318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130947319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130947319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130947319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:49.117754 run patchelf(pid=8852): Terminating (SIGINT) 13:09:49.291342 run patchelf(pid=8852): Terminated: ok {rc=0} 13:09:49.415825 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8849): Process ended prematurely: osmo-stp_10.42.42.5(pid=8849) [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8849)] [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 13:09:49.425368 tst iperf3.py:8: Test FAILED (8.0 sec) 13:09:49.452376 run osmo-hlr_10.42.42.2(pid=8846): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8846)] 13:09:49.500023 run osmo-hlr_10.42.42.2(pid=8846): stdout: | (launched: 2022-12-09_13:09:45.753770) 13:09:49.549576 run osmo-hlr_10.42.42.2(pid=8846): stderr: | 20221209130946036 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130946036 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130946036 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130946036 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130946036 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130946036 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130946055 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130946069 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130946070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130946070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:49.599671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8841): Terminating (SIGTERM) 13:09:49.639418 run iperf3-srv_10.42.42.10(pid=8842): Terminating (SIGTERM) 13:09:49.678952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8845): Terminating (SIGTERM) 13:09:49.718606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8848): Terminating (SIGTERM) 13:09:49.758128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8851): Terminating (SIGTERM) 13:09:49.797987 --- ParallelTerminationStrategy: PID 8841 died... 13:09:49.817387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8841): Terminated: ok {rc=0} 13:09:49.861889 --- ParallelTerminationStrategy: PID 8842 died... 13:09:49.880736 run iperf3-srv_10.42.42.10(pid=8842): Terminated {rc=256} 13:09:49.924877 --- ParallelTerminationStrategy: PID 8845 died... 13:09:49.943935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8845): Terminated: ok {rc=0} 13:09:49.988016 --- ParallelTerminationStrategy: PID 8848 died... 13:09:50.006656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8848): Terminated: ok {rc=0} 13:09:50.050505 --- ParallelTerminationStrategy: PID 8851 died... 13:09:50.069505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8851): Terminated: ok {rc=0} 13:09:50.156647 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:09:51.306904 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:51.318611 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:09:51.368886 tst iperf3m4.py: using LAC 21679 13:09:51.493435 tst iperf3m4.py: using RAC 4 13:09:51.616775 tst iperf3m4.py: using CellId 21679 13:09:51.740379 tst iperf3m4.py: using BVCI 21680 13:09:51.855110 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:51.866085 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:51.876781 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:51.888012 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:51.898595 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:51.909163 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:51.919896 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:51.930564 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:09:51.941338 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:09:52.059813 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:09:52.181747 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:09:52.300292 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:09:52.416936 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:09:52.625862 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:52.938909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8853): Launched 13:09:53.213559 run iperf3-srv_10.42.42.10(pid=8854): Launched 13:09:53.330450 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:09:53.538105 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:53.850585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8855): Launched 13:09:54.122501 run iperf3-srv_10.42.42.10(pid=8856): Launched 13:09:54.238859 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:09:54.445724 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:54.756750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8857): Launched 13:09:55.026737 run iperf3-srv_10.42.42.10(pid=8858): Launched 13:09:55.145423 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:09:55.353284 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:55.664565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8859): Launched 13:09:55.934843 run iperf3-srv_10.42.42.10(pid=8860): Launched 13:09:56.051306 tst iperf3m4.py:8: start network... 13:09:56.259017 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:56.740817 run create_hlr_db(pid=8861): Launched 13:09:56.868095 bus /gobi_6: Setting Powered False 13:09:57.929124 run create_hlr_db(pid=8861): Terminated: ok {rc=0} 13:09:58.382035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8864): Launched 13:09:58.715338 run osmo-hlr_10.42.42.2(pid=8865): Launched 13:09:58.842481 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:59.407911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8867): Launched 13:09:59.707974 run osmo-stp_10.42.42.5(pid=8868): Launched 13:09:59.824635 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:10:00.351345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8870): Launched 13:10:00.467307 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:10:00.725510 run patchelf(pid=8871): Launched 13:10:00.910892 run osmo-stp_10.42.42.5(pid=8868): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8868)] 13:10:01.043521 run osmo-stp_10.42.42.5(pid=8868): stdout: | (launched: 2022-12-09_13:09:59.652802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:01.193742 run osmo-stp_10.42.42.5(pid=8868): stderr: | 20221209130959819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130959819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130959820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130959820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130959821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130959821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130959821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:01.330648 run osmo-stp_10.42.42.5(pid=8868): stdout: | (launched: 2022-12-09_13:09:59.652802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:01.460242 run osmo-stp_10.42.42.5(pid=8868): stderr: | 20221209130959819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209130959819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209130959820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209130959820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209130959821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209130959821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209130959821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:01.613378 run patchelf(pid=8871): Terminating (SIGINT) 13:10:01.789125 run patchelf(pid=8871): Terminated: ok {rc=0} 13:10:01.915771 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8868): Process ended prematurely: osmo-stp_10.42.42.5(pid=8868) [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8868)] [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 13:10:01.926410 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:10:01.955492 run osmo-hlr_10.42.42.2(pid=8865): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8865)] 13:10:02.004710 run osmo-hlr_10.42.42.2(pid=8865): stdout: | (launched: 2022-12-09_13:09:58.654335) 13:10:02.056193 run osmo-hlr_10.42.42.2(pid=8865): stderr: | 20221209130958850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209130958850 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209130958850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209130958850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209130958850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209130958850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209130958863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209130958874 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209130958874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209130958874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:02.107248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8853): Terminating (SIGTERM) 13:10:02.148761 run iperf3-srv_10.42.42.10(pid=8854): Terminating (SIGTERM) 13:10:02.189819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8855): Terminating (SIGTERM) 13:10:02.231047 run iperf3-srv_10.42.42.10(pid=8856): Terminating (SIGTERM) 13:10:02.271306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8857): Terminating (SIGTERM) 13:10:02.311697 run iperf3-srv_10.42.42.10(pid=8858): Terminating (SIGTERM) 13:10:02.352038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8859): Terminating (SIGTERM) 13:10:02.392342 run iperf3-srv_10.42.42.10(pid=8860): Terminating (SIGTERM) 13:10:02.432661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8864): Terminating (SIGTERM) 13:10:02.472729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8867): Terminating (SIGTERM) 13:10:02.512919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8870): Terminating (SIGTERM) 13:10:02.553381 --- ParallelTerminationStrategy: PID 8853 died... 13:10:02.572657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8853): Terminated: ok {rc=0} 13:10:02.617295 --- ParallelTerminationStrategy: PID 8854 died... 13:10:02.636059 run iperf3-srv_10.42.42.10(pid=8854): Terminated {rc=256} 13:10:02.680282 --- ParallelTerminationStrategy: PID 8855 died... 13:10:02.699193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8855): Terminated: ok {rc=0} 13:10:02.743627 --- ParallelTerminationStrategy: PID 8856 died... 13:10:02.762609 run iperf3-srv_10.42.42.10(pid=8856): Terminated {rc=256} 13:10:02.806935 --- ParallelTerminationStrategy: PID 8857 died... 13:10:02.826099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8857): Terminated: ok {rc=0} 13:10:02.870254 --- ParallelTerminationStrategy: PID 8858 died... 13:10:02.889141 run iperf3-srv_10.42.42.10(pid=8858): Terminated {rc=256} 13:10:02.933237 --- ParallelTerminationStrategy: PID 8859 died... 13:10:02.951954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8859): Terminated: ok {rc=0} 13:10:02.996301 --- ParallelTerminationStrategy: PID 8860 died... 13:10:03.015396 run iperf3-srv_10.42.42.10(pid=8860): Terminated {rc=256} 13:10:03.059685 --- ParallelTerminationStrategy: PID 8864 died... 13:10:03.078789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8864): Terminated: ok {rc=0} 13:10:03.123206 --- ParallelTerminationStrategy: PID 8867 died... 13:10:03.142229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8867): Terminated: ok {rc=0} 13:10:03.186646 --- ParallelTerminationStrategy: PID 8870 died... 13:10:03.205924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8870): Terminated: ok {rc=0} 13:10:03.292708 bus /gobi_4: Setting Powered False 13:10:04.393522 bus /gobi_4: Setting Powered False 13:10:05.510930 bus /gobi_1: Setting Powered False 13:10:06.612877 bus /gobi_1: Setting Powered False 13:10:07.730143 bus /gobi_0: Setting Powered False 13:10:08.830878 bus /gobi_0: Setting Powered False 13:10:09.950228 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 13:10:11.053871 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:10:11.065893 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:10:11.118829 tst ping.py: using LAC 21680 13:10:11.246827 tst ping.py: using RAC 5 13:10:11.373312 tst ping.py: using CellId 21680 13:10:11.501654 tst ping.py: using BVCI 21681 13:10:11.613474 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:10:11.624771 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:10:11.635757 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:10:11.647345 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:10:11.658707 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:10:11.670243 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:10:11.681876 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:10:11.693404 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:10:11.812656 tst ping.py:19: start network... 13:10:12.031344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:12.532690 run create_hlr_db(pid=8875): Launched 13:10:12.656541 bus /gobi_6: Setting Powered False 13:10:13.721143 run create_hlr_db(pid=8875): Terminated: ok {rc=0} 13:10:14.156062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8877): Launched 13:10:14.461023 run osmo-hlr_10.42.42.2(pid=8878): Launched 13:10:14.577182 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:15.127729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8880): Launched 13:10:15.431353 run osmo-stp_10.42.42.5(pid=8881): Launched 13:10:15.547436 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:10:16.094074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8883): Launched 13:10:16.224601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:10:16.489595 run patchelf(pid=8884): Launched 13:10:16.675797 run osmo-stp_10.42.42.5(pid=8881): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8881)] 13:10:16.806897 run osmo-stp_10.42.42.5(pid=8881): stdout: | (launched: 2022-12-09_13:10:15.374817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:16.939411 run osmo-stp_10.42.42.5(pid=8881): stderr: | 20221209131015544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131015545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131015545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131015545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131015546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131015546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131015546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:17.071352 run osmo-stp_10.42.42.5(pid=8881): stdout: | (launched: 2022-12-09_13:10:15.374817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:17.197990 run osmo-stp_10.42.42.5(pid=8881): stderr: | 20221209131015544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131015545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131015545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131015545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131015546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131015546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131015546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:17.345586 run patchelf(pid=8884): Terminating (SIGINT) 13:10:17.516058 run patchelf(pid=8884): Terminated: ok {rc=0} 13:10:17.638843 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8881): Process ended prematurely: osmo-stp_10.42.42.5(pid=8881) [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8881)] [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 13:10:17.647907 tst ping.py:22: Test FAILED (6.6 sec) 13:10:17.675783 run osmo-hlr_10.42.42.2(pid=8878): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8878)] 13:10:17.724545 run osmo-hlr_10.42.42.2(pid=8878): stdout: | (launched: 2022-12-09_13:10:14.404382) 13:10:17.774988 run osmo-hlr_10.42.42.2(pid=8878): stderr: | 20221209131014582 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131014582 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131014582 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131014582 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131014582 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131014582 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131014595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131014605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131014605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131014605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:17.825947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8877): Terminating (SIGTERM) 13:10:17.867006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8880): Terminating (SIGTERM) 13:10:17.907858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8883): Terminating (SIGTERM) 13:10:17.948815 --- ParallelTerminationStrategy: PID 8877 died... 13:10:17.968030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8877): Terminated: ok {rc=0} 13:10:18.013301 --- ParallelTerminationStrategy: PID 8880 died... 13:10:18.032088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8880): Terminated: ok {rc=0} 13:10:18.077051 --- ParallelTerminationStrategy: PID 8883 died... 13:10:18.095905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8883): Terminated: ok {rc=0} 13:10:18.183124 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:10:19.271423 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:10:19.283834 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:10:19.337598 tst ping_idle_ping.py: using LAC 21681 13:10:19.458987 tst ping_idle_ping.py: using RAC 6 13:10:19.580209 tst ping_idle_ping.py: using CellId 21681 13:10:19.701063 tst ping_idle_ping.py: using BVCI 21682 13:10:19.812538 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:10:19.823790 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:10:19.834520 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:10:19.845193 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:10:19.855813 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:10:19.866447 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:10:19.877254 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:10:19.887876 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:10:20.005880 tst ping_idle_ping.py:24: start network... 13:10:20.224175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:20.728496 run create_hlr_db(pid=8885): Launched 13:10:20.851947 bus /gobi_6: Setting Powered False 13:10:21.916643 run create_hlr_db(pid=8885): Terminated: ok {rc=0} 13:10:22.350775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8887): Launched 13:10:22.654529 run osmo-hlr_10.42.42.2(pid=8888): Launched 13:10:22.769864 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:23.291885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8890): Launched 13:10:23.597468 run osmo-stp_10.42.42.5(pid=8891): Launched 13:10:23.713712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:10:24.238704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8893): Launched 13:10:24.355738 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:10:24.613044 run patchelf(pid=8894): Launched 13:10:24.794691 run osmo-stp_10.42.42.5(pid=8891): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8891)] 13:10:24.932583 run osmo-stp_10.42.42.5(pid=8891): stdout: | (launched: 2022-12-09_13:10:23.541030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:25.072123 run osmo-stp_10.42.42.5(pid=8891): stderr: | 20221209131023713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131023713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131023714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131023714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131023714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131023715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131023715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:25.211739 run osmo-stp_10.42.42.5(pid=8891): stdout: | (launched: 2022-12-09_13:10:23.541030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:25.344858 run osmo-stp_10.42.42.5(pid=8891): stderr: | 20221209131023713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131023713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131023714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131023714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131023714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131023715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131023715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:25.503200 run patchelf(pid=8894): Terminating (SIGINT) 13:10:25.684695 run patchelf(pid=8894): Terminated: ok {rc=0} 13:10:25.816182 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8891): Process ended prematurely: osmo-stp_10.42.42.5(pid=8891) [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8891)] [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 13:10:25.825763 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:10:25.854444 run osmo-hlr_10.42.42.2(pid=8888): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8888)] 13:10:25.905970 run osmo-hlr_10.42.42.2(pid=8888): stdout: | (launched: 2022-12-09_13:10:22.598397) 13:10:25.959009 run osmo-hlr_10.42.42.2(pid=8888): stderr: | 20221209131022775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131022775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131022775 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131022775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131022775 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131022775 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131022786 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131022795 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131022795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131022796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:26.012614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8887): Terminating (SIGTERM) 13:10:26.055471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8890): Terminating (SIGTERM) 13:10:26.098574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8893): Terminating (SIGTERM) 13:10:26.141895 --- ParallelTerminationStrategy: PID 8887 died... 13:10:26.162308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8887): Terminated: ok {rc=0} 13:10:26.209837 --- ParallelTerminationStrategy: PID 8890 died... 13:10:26.229550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8890): Terminated: ok {rc=0} 13:10:26.276766 --- ParallelTerminationStrategy: PID 8893 died... 13:10:26.296615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8893): Terminated: ok {rc=0} 13:10:26.386224 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:10:27.709900 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:10:27.716202 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:10:27.751025 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:10:27.790705 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:10:27.877686 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:10:27.911776 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:10:27.951409 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:10:28.549755 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:10:28.603062 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:28.614466 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:10:28.683988 tst cs_paging_gprs_active.py: using LAC 21682 13:10:28.811899 tst cs_paging_gprs_active.py: using RAC 7 13:10:28.939153 tst cs_paging_gprs_active.py: using CellId 21682 13:10:29.063900 tst cs_paging_gprs_active.py: using BVCI 21683 13:10:29.177884 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:29.188818 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:29.199777 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:29.210571 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:29.221263 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:29.231838 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:29.242557 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:29.253572 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:29.264404 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:10:29.379401 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:10:29.499743 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:10:29.723534 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:30.058024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8899): Launched 13:10:30.343778 run iperf3-srv_10.42.42.10(pid=8900): Launched 13:10:30.466966 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:10:30.688243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:31.048283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8901): Launched 13:10:31.342648 run iperf3-srv_10.42.42.10(pid=8902): Launched 13:10:31.473813 tst cs_paging_gprs_active.py:38: start network... 13:10:31.687668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:32.187177 run create_hlr_db(pid=8903): Launched 13:10:32.317140 bus /gobi_6: Setting Powered False 13:10:33.381552 run create_hlr_db(pid=8903): Terminated: ok {rc=0} 13:10:33.819928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8905): Launched 13:10:34.127636 run osmo-hlr_10.42.42.2(pid=8906): Launched 13:10:34.244216 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:34.782977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8908): Launched 13:10:35.090673 run osmo-stp_10.42.42.5(pid=8909): Launched 13:10:35.207450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:10:35.737599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8911): Launched 13:10:35.854740 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:10:36.114188 run patchelf(pid=8912): Launched 13:10:36.285404 run osmo-stp_10.42.42.5(pid=8909): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8909)] 13:10:36.415097 run osmo-stp_10.42.42.5(pid=8909): stdout: | (launched: 2022-12-09_13:10:35.034121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:36.546627 run osmo-stp_10.42.42.5(pid=8909): stderr: | 20221209131035201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131035202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131035202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131035202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131035203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131035203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131035203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:36.678708 run osmo-stp_10.42.42.5(pid=8909): stdout: | (launched: 2022-12-09_13:10:35.034121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:36.804770 run osmo-stp_10.42.42.5(pid=8909): stderr: | 20221209131035201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131035202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131035202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131035202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131035203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131035203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131035203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:36.954497 run patchelf(pid=8912): Terminating (SIGINT) 13:10:37.125869 run patchelf(pid=8912): Terminated: ok {rc=0} 13:10:37.249480 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8909): Process ended prematurely: osmo-stp_10.42.42.5(pid=8909) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8909)] [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:10:37.258820 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:10:37.285763 run osmo-hlr_10.42.42.2(pid=8906): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8906)] 13:10:37.333045 run osmo-hlr_10.42.42.2(pid=8906): stdout: | (launched: 2022-12-09_13:10:34.071108) 13:10:37.382361 run osmo-hlr_10.42.42.2(pid=8906): stderr: | 20221209131034247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131034247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131034247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131034247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131034247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131034247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131034259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131034267 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131034268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131034268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:37.431958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8899): Terminating (SIGTERM) 13:10:37.471668 run iperf3-srv_10.42.42.10(pid=8900): Terminating (SIGTERM) 13:10:37.511133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8901): Terminating (SIGTERM) 13:10:37.551045 run iperf3-srv_10.42.42.10(pid=8902): Terminating (SIGTERM) 13:10:37.590713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8905): Terminating (SIGTERM) 13:10:37.630180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8908): Terminating (SIGTERM) 13:10:37.669611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8911): Terminating (SIGTERM) 13:10:37.709864 --- ParallelTerminationStrategy: PID 8899 died... 13:10:37.729145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8899): Terminated: ok {rc=0} 13:10:37.773446 --- ParallelTerminationStrategy: PID 8900 died... 13:10:37.792007 run iperf3-srv_10.42.42.10(pid=8900): Terminated {rc=256} 13:10:37.836039 --- ParallelTerminationStrategy: PID 8901 died... 13:10:37.854757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8901): Terminated: ok {rc=0} 13:10:37.898856 --- ParallelTerminationStrategy: PID 8902 died... 13:10:37.917533 run iperf3-srv_10.42.42.10(pid=8902): Terminated {rc=256} 13:10:37.961455 --- ParallelTerminationStrategy: PID 8905 died... 13:10:37.980080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8905): Terminated: ok {rc=0} 13:10:38.024066 --- ParallelTerminationStrategy: PID 8908 died... 13:10:38.042873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8908): Terminated: ok {rc=0} 13:10:38.086873 --- ParallelTerminationStrategy: PID 8911 died... 13:10:38.105677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8911): Terminated: ok {rc=0} 13:10:38.192208 bus /gobi_0: Setting Powered False 13:10:39.292929 bus /gobi_0: Setting Powered False 13:10:40.409756 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:10:41.555785 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:41.567404 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:10:41.640434 tst iperf3.py: using LAC 21683 13:10:41.759219 tst iperf3.py: using RAC 8 13:10:41.880675 tst iperf3.py: using CellId 21683 13:10:42.024198 tst iperf3.py: using BVCI 21684 13:10:42.135692 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:42.146573 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:42.157234 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:42.167771 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:42.178338 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:42.188869 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:42.199575 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:42.210090 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:42.221053 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:10:42.338699 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:10:42.556748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:42.881214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8913): Launched 13:10:43.161617 run iperf3-srv_10.42.42.10(pid=8914): Launched 13:10:43.282730 tst iperf3.py:8: start network... 13:10:43.500720 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:44.002441 run create_hlr_db(pid=8915): Launched 13:10:44.126905 bus /gobi_6: Setting Powered False 13:10:45.190827 run create_hlr_db(pid=8915): Terminated: ok {rc=0} 13:10:45.622501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8917): Launched 13:10:45.950086 run osmo-hlr_10.42.42.2(pid=8918): Launched 13:10:46.100648 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:46.969734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8920): Launched 13:10:47.321827 run osmo-stp_10.42.42.5(pid=8921): Launched 13:10:47.449726 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:10:48.016547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8923): Launched 13:10:48.140676 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:10:48.415890 run patchelf(pid=8924): Launched 13:10:48.595640 run osmo-stp_10.42.42.5(pid=8921): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8921)] 13:10:48.733876 run osmo-stp_10.42.42.5(pid=8921): stdout: | (launched: 2022-12-09_13:10:47.257087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:48.873572 run osmo-stp_10.42.42.5(pid=8921): stderr: | 20221209131047455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131047455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131047456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131047456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131047457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131047457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131047457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:49.012723 run osmo-stp_10.42.42.5(pid=8921): stdout: | (launched: 2022-12-09_13:10:47.257087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:49.146425 run osmo-stp_10.42.42.5(pid=8921): stderr: | 20221209131047455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131047455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131047456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131047456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131047457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131047457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131047457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:49.304298 run patchelf(pid=8924): Terminating (SIGINT) 13:10:49.485996 run patchelf(pid=8924): Terminated: ok {rc=0} 13:10:49.616698 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8921): Process ended prematurely: osmo-stp_10.42.42.5(pid=8921) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8921)] [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 13:10:49.626898 tst iperf3.py:8: Test FAILED (8.1 sec) 13:10:49.656348 run osmo-hlr_10.42.42.2(pid=8918): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8918)] 13:10:49.707061 run osmo-hlr_10.42.42.2(pid=8918): stdout: | (launched: 2022-12-09_13:10:45.878125) 13:10:49.759708 run osmo-hlr_10.42.42.2(pid=8918): stderr: | 20221209131046294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131046294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131046294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131046294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131046294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131046294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131046312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131046336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131046336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131046336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:49.812581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8913): Terminating (SIGTERM) 13:10:49.854929 run iperf3-srv_10.42.42.10(pid=8914): Terminating (SIGTERM) 13:10:49.897276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8917): Terminating (SIGTERM) 13:10:49.939683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8920): Terminating (SIGTERM) 13:10:49.982018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8923): Terminating (SIGTERM) 13:10:50.025164 --- ParallelTerminationStrategy: PID 8913 died... 13:10:50.045732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8913): Terminated: ok {rc=0} 13:10:50.092748 --- ParallelTerminationStrategy: PID 8914 died... 13:10:50.112359 run iperf3-srv_10.42.42.10(pid=8914): Terminated {rc=256} 13:10:50.158729 --- ParallelTerminationStrategy: PID 8917 died... 13:10:50.178354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8917): Terminated: ok {rc=0} 13:10:50.224852 --- ParallelTerminationStrategy: PID 8920 died... 13:10:50.244809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8920): Terminated: ok {rc=0} 13:10:50.291605 --- ParallelTerminationStrategy: PID 8923 died... 13:10:50.311649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8923): Terminated: ok {rc=0} 13:10:50.401461 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:10:51.550749 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:51.562899 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:10:51.634145 tst iperf3m4.py: using LAC 21684 13:10:51.760138 tst iperf3m4.py: using RAC 9 13:10:51.886228 tst iperf3m4.py: using CellId 21684 13:10:52.004614 tst iperf3m4.py: using BVCI 21685 13:10:52.114898 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:52.126033 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:52.136702 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:52.147526 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:52.158331 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:52.169200 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:52.179859 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:52.190417 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:10:52.201147 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:10:52.321319 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:10:52.439451 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:10:52.558874 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:10:52.676843 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:10:52.896941 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:53.224458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8925): Launched 13:10:53.508516 run iperf3-srv_10.42.42.10(pid=8926): Launched 13:10:53.630813 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:10:53.850493 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:54.176615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8927): Launched 13:10:54.458494 run iperf3-srv_10.42.42.10(pid=8928): Launched 13:10:54.580016 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:10:54.799579 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:55.126110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8929): Launched 13:10:55.408260 run iperf3-srv_10.42.42.10(pid=8930): Launched 13:10:55.530688 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:10:55.750052 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:56.076189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8931): Launched 13:10:56.359197 run iperf3-srv_10.42.42.10(pid=8932): Launched 13:10:56.481988 tst iperf3m4.py:8: start network... 13:10:56.701117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:57.208092 run create_hlr_db(pid=8933): Launched 13:10:57.332941 bus /gobi_6: Setting Powered False 13:10:58.397631 run create_hlr_db(pid=8933): Terminated: ok {rc=0} 13:10:58.849099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8935): Launched 13:10:59.173992 run osmo-hlr_10.42.42.2(pid=8936): Launched 13:10:59.297519 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:59.858393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8938): Launched 13:11:00.183091 run osmo-stp_10.42.42.5(pid=8939): Launched 13:11:00.308405 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:11:00.877854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8941): Launched 13:11:01.030923 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:11:01.395605 run patchelf(pid=8942): Launched 13:11:01.590644 run osmo-stp_10.42.42.5(pid=8939): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8939)] 13:11:01.733976 run osmo-stp_10.42.42.5(pid=8939): stdout: | (launched: 2022-12-09_13:11:00.123658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:01.879361 run osmo-stp_10.42.42.5(pid=8939): stderr: | 20221209131100311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131100311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131100311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131100312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131100312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131100313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131100313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:02.024200 run osmo-stp_10.42.42.5(pid=8939): stdout: | (launched: 2022-12-09_13:11:00.123658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:02.163294 run osmo-stp_10.42.42.5(pid=8939): stderr: | 20221209131100311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131100311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131100311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131100312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131100312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131100313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131100313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:02.326714 run patchelf(pid=8942): Terminating (SIGINT) 13:11:02.510464 run patchelf(pid=8942): Terminated: ok {rc=0} 13:11:02.642714 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8939): Process ended prematurely: osmo-stp_10.42.42.5(pid=8939) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8939)] [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:11:02.652865 tst iperf3m4.py:8: Test FAILED (11.1 sec) 13:11:02.682540 run osmo-hlr_10.42.42.2(pid=8936): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8936)] 13:11:02.733920 run osmo-hlr_10.42.42.2(pid=8936): stdout: | (launched: 2022-12-09_13:10:59.114419) 13:11:02.786498 run osmo-hlr_10.42.42.2(pid=8936): stderr: | 20221209131059307 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131059307 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131059307 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131059307 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131059308 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131059308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131059319 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131059328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131059328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131059328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:02.839610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8925): Terminating (SIGTERM) 13:11:02.882473 run iperf3-srv_10.42.42.10(pid=8926): Terminating (SIGTERM) 13:11:02.925200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8927): Terminating (SIGTERM) 13:11:02.968087 run iperf3-srv_10.42.42.10(pid=8928): Terminating (SIGTERM) 13:11:03.010753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8929): Terminating (SIGTERM) 13:11:03.053678 run iperf3-srv_10.42.42.10(pid=8930): Terminating (SIGTERM) 13:11:03.096336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8931): Terminating (SIGTERM) 13:11:03.139012 run iperf3-srv_10.42.42.10(pid=8932): Terminating (SIGTERM) 13:11:03.181720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8935): Terminating (SIGTERM) 13:11:03.224319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8938): Terminating (SIGTERM) 13:11:03.267010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8941): Terminating (SIGTERM) 13:11:03.310001 --- ParallelTerminationStrategy: PID 8925 died... 13:11:03.330575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8925): Terminated: ok {rc=0} 13:11:03.378060 --- ParallelTerminationStrategy: PID 8926 died... 13:11:03.397879 run iperf3-srv_10.42.42.10(pid=8926): Terminated {rc=256} 13:11:03.445087 --- ParallelTerminationStrategy: PID 8927 died... 13:11:03.464740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8927): Terminated: ok {rc=0} 13:11:03.512019 --- ParallelTerminationStrategy: PID 8928 died... 13:11:03.531899 run iperf3-srv_10.42.42.10(pid=8928): Terminated {rc=256} 13:11:03.578861 --- ParallelTerminationStrategy: PID 8929 died... 13:11:03.599098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8929): Terminated: ok {rc=0} 13:11:03.646304 --- ParallelTerminationStrategy: PID 8930 died... 13:11:03.666026 run iperf3-srv_10.42.42.10(pid=8930): Terminated {rc=256} 13:11:03.712881 --- ParallelTerminationStrategy: PID 8931 died... 13:11:03.733064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8931): Terminated: ok {rc=0} 13:11:03.780424 --- ParallelTerminationStrategy: PID 8932 died... 13:11:03.800313 run iperf3-srv_10.42.42.10(pid=8932): Terminated {rc=256} 13:11:03.847112 --- ParallelTerminationStrategy: PID 8935 died... 13:11:03.866793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8935): Terminated: ok {rc=0} 13:11:03.913677 --- ParallelTerminationStrategy: PID 8938 died... 13:11:03.933508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8938): Terminated: ok {rc=0} 13:11:03.980502 --- ParallelTerminationStrategy: PID 8941 died... 13:11:04.000404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8941): Terminated: ok {rc=0} 13:11:04.089605 bus /gobi_4: Setting Powered False 13:11:05.190561 bus /gobi_4: Setting Powered False 13:11:06.308654 bus /gobi_1: Setting Powered False 13:11:07.408318 bus /gobi_1: Setting Powered False 13:11:08.524775 bus /gobi_0: Setting Powered False 13:11:09.624851 bus /gobi_0: Setting Powered False 13:11:10.741041 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:11:11.844686 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:11:11.856621 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:11:11.927237 tst ping.py: using LAC 21685 13:11:12.049964 tst ping.py: using RAC 10 13:11:12.167900 tst ping.py: using CellId 21685 13:11:12.285225 tst ping.py: using BVCI 21686 13:11:12.394710 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:11:12.405891 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:11:12.416769 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:11:12.427613 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:11:12.438416 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:11:12.449174 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:11:12.460082 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:11:12.470808 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:11:12.588206 tst ping.py:19: start network... 13:11:12.805521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:13.303442 run create_hlr_db(pid=8943): Launched 13:11:13.427573 bus /gobi_6: Setting Powered False 13:11:14.491110 run create_hlr_db(pid=8943): Terminated: ok {rc=0} 13:11:14.922612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8945): Launched 13:11:15.226814 run osmo-hlr_10.42.42.2(pid=8946): Launched 13:11:15.341899 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:15.893736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8948): Launched 13:11:16.260212 run osmo-stp_10.42.42.5(pid=8949): Launched 13:11:16.515382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:11:17.176268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8951): Launched 13:11:17.299499 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:11:17.571391 run patchelf(pid=8952): Launched 13:11:17.751104 run osmo-stp_10.42.42.5(pid=8949): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8949)] 13:11:17.887637 run osmo-stp_10.42.42.5(pid=8949): stdout: | (launched: 2022-12-09_13:11:16.197527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:18.025358 run osmo-stp_10.42.42.5(pid=8949): stderr: | 20221209131116483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131116483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131116484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131116484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131116484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131116485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131116485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:18.162969 run osmo-stp_10.42.42.5(pid=8949): stdout: | (launched: 2022-12-09_13:11:16.197527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:18.294663 run osmo-stp_10.42.42.5(pid=8949): stderr: | 20221209131116483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131116483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131116484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131116484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131116484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131116485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131116485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:18.451046 run patchelf(pid=8952): Terminating (SIGINT) 13:11:18.630315 run patchelf(pid=8952): Terminated: ok {rc=0} 13:11:18.760202 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8949): Process ended prematurely: osmo-stp_10.42.42.5(pid=8949) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8949)] [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 13:11:18.769824 tst ping.py:22: Test FAILED (6.9 sec) 13:11:18.798929 run osmo-hlr_10.42.42.2(pid=8946): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8946)] 13:11:18.849799 run osmo-hlr_10.42.42.2(pid=8946): stdout: | (launched: 2022-12-09_13:11:15.171542) 13:11:18.902612 run osmo-hlr_10.42.42.2(pid=8946): stderr: | 20221209131115346 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131115346 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131115346 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131115346 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131115346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131115346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131115358 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131115367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131115367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131115367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:18.955961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8945): Terminating (SIGTERM) 13:11:18.998923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8948): Terminating (SIGTERM) 13:11:19.041825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8951): Terminating (SIGTERM) 13:11:19.084894 --- ParallelTerminationStrategy: PID 8945 died... 13:11:19.105291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8945): Terminated: ok {rc=0} 13:11:19.152648 --- ParallelTerminationStrategy: PID 8948 died... 13:11:19.172500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8948): Terminated: ok {rc=0} 13:11:19.219523 --- ParallelTerminationStrategy: PID 8951 died... 13:11:19.239376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8951): Terminated: ok {rc=0} 13:11:19.328219 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:11:20.415870 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:11:20.428016 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:11:20.501640 tst ping_idle_ping.py: using LAC 21686 13:11:20.629305 tst ping_idle_ping.py: using RAC 11 13:11:20.749071 tst ping_idle_ping.py: using CellId 21686 13:11:20.867934 tst ping_idle_ping.py: using BVCI 21687 13:11:20.979189 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:11:20.990515 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:11:21.001490 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:11:21.012412 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:11:21.023866 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:11:21.034836 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:11:21.045918 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:11:21.056668 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:11:21.175135 tst ping_idle_ping.py:24: start network... 13:11:21.393538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:21.901117 run create_hlr_db(pid=8953): Launched 13:11:22.024403 bus /gobi_6: Setting Powered False 13:11:23.088070 run create_hlr_db(pid=8953): Terminated: ok {rc=0} 13:11:23.519505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8955): Launched 13:11:23.820214 run osmo-hlr_10.42.42.2(pid=8956): Launched 13:11:23.936365 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:24.462106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8958): Launched 13:11:24.763044 run osmo-stp_10.42.42.5(pid=8959): Launched 13:11:24.877531 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:11:25.398254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8961): Launched 13:11:25.513521 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:11:25.768808 run patchelf(pid=8962): Launched 13:11:25.937466 run osmo-stp_10.42.42.5(pid=8959): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8959)] 13:11:26.066005 run osmo-stp_10.42.42.5(pid=8959): stdout: | (launched: 2022-12-09_13:11:24.707404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:26.195746 run osmo-stp_10.42.42.5(pid=8959): stderr: | 20221209131124875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131124875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131124875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131124876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131124876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131124876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131124876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:26.324735 run osmo-stp_10.42.42.5(pid=8959): stdout: | (launched: 2022-12-09_13:11:24.707404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:26.448355 run osmo-stp_10.42.42.5(pid=8959): stderr: | 20221209131124875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131124875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131124875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131124876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131124876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131124876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131124876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:26.594763 run patchelf(pid=8962): Terminating (SIGINT) 13:11:26.763983 run patchelf(pid=8962): Terminated: ok {rc=0} 13:11:26.885705 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8959): Process ended prematurely: osmo-stp_10.42.42.5(pid=8959) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8959)] [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:11:26.894485 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:11:26.920904 run osmo-hlr_10.42.42.2(pid=8956): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8956)] 13:11:26.969338 run osmo-hlr_10.42.42.2(pid=8956): stdout: | (launched: 2022-12-09_13:11:23.765067) 13:11:27.019208 run osmo-hlr_10.42.42.2(pid=8956): stderr: | 20221209131123937 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131123937 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131123937 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131123938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131123938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131123938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131123949 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131123958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131123958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131123958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:27.069486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8955): Terminating (SIGTERM) 13:11:27.109928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8958): Terminating (SIGTERM) 13:11:27.150104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8961): Terminating (SIGTERM) 13:11:27.190208 --- ParallelTerminationStrategy: PID 8955 died... 13:11:27.209342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8955): Terminated: ok {rc=0} 13:11:27.253173 --- ParallelTerminationStrategy: PID 8958 died... 13:11:27.271918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8958): Terminated: ok {rc=0} 13:11:27.315954 --- ParallelTerminationStrategy: PID 8961 died... 13:11:27.334670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8961): Terminated: ok {rc=0} 13:11:27.417791 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:11:28.721222 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:11:28.727298 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:11:28.760542 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:11:28.799038 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:11:28.890242 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:11:28.925486 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:11:28.965586 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:11:29.555198 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:11:29.605482 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:29.616514 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:11:29.685851 tst cs_paging_gprs_active.py: using LAC 21687 13:11:29.806758 tst cs_paging_gprs_active.py: using RAC 12 13:11:29.929720 tst cs_paging_gprs_active.py: using CellId 21687 13:11:30.051465 tst cs_paging_gprs_active.py: using BVCI 21688 13:11:30.163346 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:30.174330 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:30.185137 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:30.195881 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:30.206573 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:30.217405 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:30.228138 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:30.238816 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:30.249781 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:11:30.368291 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:11:30.486423 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:11:30.695622 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:11:31.057902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8966): Launched 13:11:31.334394 run iperf3-srv_10.42.42.10(pid=8967): Launched 13:11:31.467016 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:11:31.678187 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:11:31.997039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8968): Launched 13:11:32.280744 run iperf3-srv_10.42.42.10(pid=8969): Launched 13:11:32.395596 tst cs_paging_gprs_active.py:38: start network... 13:11:32.601300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:33.078312 run create_hlr_db(pid=8970): Launched 13:11:33.205473 bus /gobi_6: Setting Powered False 13:11:34.266051 run create_hlr_db(pid=8970): Terminated: ok {rc=0} 13:11:34.711760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8972): Launched 13:11:35.038968 run osmo-hlr_10.42.42.2(pid=8973): Launched 13:11:35.163816 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:35.727441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8975): Launched 13:11:36.055594 run osmo-stp_10.42.42.5(pid=8976): Launched 13:11:36.181524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:11:36.748926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8978): Launched 13:11:36.874009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:11:37.151609 run patchelf(pid=8979): Launched 13:11:37.333504 run osmo-stp_10.42.42.5(pid=8976): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8976)] 13:11:37.472701 run osmo-stp_10.42.42.5(pid=8976): stdout: | (launched: 2022-12-09_13:11:35.995494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:37.613584 run osmo-stp_10.42.42.5(pid=8976): stderr: | 20221209131136185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131136185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131136185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131136186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131136186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131136186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131136186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:37.754544 run osmo-stp_10.42.42.5(pid=8976): stdout: | (launched: 2022-12-09_13:11:35.995494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:37.889469 run osmo-stp_10.42.42.5(pid=8976): stderr: | 20221209131136185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131136185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131136185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131136186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131136186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131136186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131136186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:38.050101 run patchelf(pid=8979): Terminating (SIGINT) 13:11:38.233682 run patchelf(pid=8979): Terminated: ok {rc=0} 13:11:38.366037 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8976): Process ended prematurely: osmo-stp_10.42.42.5(pid=8976) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8976)] [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:11:38.376138 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:11:38.405456 run osmo-hlr_10.42.42.2(pid=8973): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8973)] 13:11:38.456036 run osmo-hlr_10.42.42.2(pid=8973): stdout: | (launched: 2022-12-09_13:11:34.979458) 13:11:38.508553 run osmo-hlr_10.42.42.2(pid=8973): stderr: | 20221209131135175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131135175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131135175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131135175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131135175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131135175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131135187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131135195 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131135196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131135196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:38.561514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8966): Terminating (SIGTERM) 13:11:38.603933 run iperf3-srv_10.42.42.10(pid=8967): Terminating (SIGTERM) 13:11:38.646534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8968): Terminating (SIGTERM) 13:11:38.688631 run iperf3-srv_10.42.42.10(pid=8969): Terminating (SIGTERM) 13:11:38.730581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8972): Terminating (SIGTERM) 13:11:38.772763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8975): Terminating (SIGTERM) 13:11:38.814941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8978): Terminating (SIGTERM) 13:11:38.857224 --- ParallelTerminationStrategy: PID 8966 died... 13:11:38.876939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8966): Terminated: ok {rc=0} 13:11:38.923794 --- ParallelTerminationStrategy: PID 8967 died... 13:11:38.943285 run iperf3-srv_10.42.42.10(pid=8967): Terminated {rc=256} 13:11:38.989854 --- ParallelTerminationStrategy: PID 8968 died... 13:11:39.009510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8968): Terminated: ok {rc=0} 13:11:39.056046 --- ParallelTerminationStrategy: PID 8969 died... 13:11:39.075552 run iperf3-srv_10.42.42.10(pid=8969): Terminated {rc=256} 13:11:39.122009 --- ParallelTerminationStrategy: PID 8972 died... 13:11:39.141540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8972): Terminated: ok {rc=0} 13:11:39.188221 --- ParallelTerminationStrategy: PID 8975 died... 13:11:39.207837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8975): Terminated: ok {rc=0} 13:11:39.254517 --- ParallelTerminationStrategy: PID 8978 died... 13:11:39.274216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8978): Terminated: ok {rc=0} 13:11:39.362533 bus /gobi_0: Setting Powered False 13:11:40.461525 bus /gobi_0: Setting Powered False 13:11:41.577777 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:11:42.726736 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:42.739203 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:11:42.825920 tst iperf3.py: using LAC 21688 13:11:42.959158 tst iperf3.py: using RAC 13 13:11:43.080231 tst iperf3.py: using CellId 21688 13:11:43.198787 tst iperf3.py: using BVCI 21689 13:11:43.311745 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:43.322918 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:43.333907 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:43.344793 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:43.355431 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:43.366106 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:43.376811 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:43.387407 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:43.398273 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:11:43.515048 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:11:43.736706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:11:44.065211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8980): Launched 13:11:44.350175 run iperf3-srv_10.42.42.10(pid=8981): Launched 13:11:44.473390 tst iperf3.py:8: start network... 13:11:44.694281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:45.202672 run create_hlr_db(pid=8982): Launched 13:11:45.327455 bus /gobi_6: Setting Powered False 13:11:46.392316 run create_hlr_db(pid=8982): Terminated: ok {rc=0} 13:11:46.853631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8984): Launched 13:11:47.194131 run osmo-hlr_10.42.42.2(pid=8985): Launched 13:11:47.319410 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:47.886964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8987): Launched 13:11:48.214517 run osmo-stp_10.42.42.5(pid=8988): Launched 13:11:48.339390 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:11:48.905443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8990): Launched 13:11:49.030284 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:11:49.307162 run patchelf(pid=8991): Launched 13:11:49.488032 run osmo-stp_10.42.42.5(pid=8988): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8988)] 13:11:49.626684 run osmo-stp_10.42.42.5(pid=8988): stdout: | (launched: 2022-12-09_13:11:48.154183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:49.767044 run osmo-stp_10.42.42.5(pid=8988): stderr: | 20221209131148345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131148345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131148346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131148346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131148347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131148347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131148347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:49.907121 run osmo-stp_10.42.42.5(pid=8988): stdout: | (launched: 2022-12-09_13:11:48.154183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:50.041683 run osmo-stp_10.42.42.5(pid=8988): stderr: | 20221209131148345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131148345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131148346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131148346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131148347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131148347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131148347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:50.200928 run patchelf(pid=8991): Terminating (SIGINT) 13:11:50.382897 run patchelf(pid=8991): Terminated: ok {rc=0} 13:11:50.514049 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8988): Process ended prematurely: osmo-stp_10.42.42.5(pid=8988) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8988)] [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 13:11:50.524150 tst iperf3.py:8: Test FAILED (7.8 sec) 13:11:50.553259 run osmo-hlr_10.42.42.2(pid=8985): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8985)] 13:11:50.604030 run osmo-hlr_10.42.42.2(pid=8985): stdout: | (launched: 2022-12-09_13:11:47.133750) 13:11:50.656470 run osmo-hlr_10.42.42.2(pid=8985): stderr: | 20221209131147332 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131147332 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131147332 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131147332 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131147332 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131147332 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131147344 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131147353 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131147353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131147353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:50.709498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8980): Terminating (SIGTERM) 13:11:50.752186 run iperf3-srv_10.42.42.10(pid=8981): Terminating (SIGTERM) 13:11:50.794690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8984): Terminating (SIGTERM) 13:11:50.836994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8987): Terminating (SIGTERM) 13:11:50.879124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8990): Terminating (SIGTERM) 13:11:50.921830 --- ParallelTerminationStrategy: PID 8980 died... 13:11:50.941951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8980): Terminated: ok {rc=0} 13:11:50.988808 --- ParallelTerminationStrategy: PID 8981 died... 13:11:51.008830 run iperf3-srv_10.42.42.10(pid=8981): Terminated {rc=256} 13:11:51.055342 --- ParallelTerminationStrategy: PID 8984 died... 13:11:51.075020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8984): Terminated: ok {rc=0} 13:11:51.122186 --- ParallelTerminationStrategy: PID 8987 died... 13:11:51.141873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8987): Terminated: ok {rc=0} 13:11:51.188372 --- ParallelTerminationStrategy: PID 8990 died... 13:11:51.208014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8990): Terminated: ok {rc=0} 13:11:51.296056 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:11:52.447805 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:52.460071 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:11:52.532100 tst iperf3m4.py: using LAC 21689 13:11:52.658438 tst iperf3m4.py: using RAC 14 13:11:52.787203 tst iperf3m4.py: using CellId 21689 13:11:52.916052 tst iperf3m4.py: using BVCI 21690 13:11:53.035451 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:53.046951 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:53.058332 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:53.069913 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:53.081396 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:53.092873 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:53.104480 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:53.115992 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:11:53.127541 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:11:53.246655 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:11:53.370296 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:11:53.490794 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:11:53.612516 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:11:53.833910 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:11:54.162638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8992): Launched 13:11:54.447957 run iperf3-srv_10.42.42.10(pid=8993): Launched 13:11:54.570694 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:11:54.791196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:11:55.119423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8994): Launched 13:11:55.403603 run iperf3-srv_10.42.42.10(pid=8995): Launched 13:11:55.526008 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:11:55.746015 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:11:56.074260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8996): Launched 13:11:56.359760 run iperf3-srv_10.42.42.10(pid=8997): Launched 13:11:56.482866 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:11:56.703205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:11:57.032426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8998): Launched 13:11:57.317480 run iperf3-srv_10.42.42.10(pid=8999): Launched 13:11:57.439721 tst iperf3m4.py:8: start network... 13:11:57.659594 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:58.167161 run create_hlr_db(pid=9000): Launched 13:11:58.291530 bus /gobi_6: Setting Powered False 13:11:59.355219 run create_hlr_db(pid=9000): Terminated: ok {rc=0} 13:11:59.792300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9002): Launched 13:12:00.100257 run osmo-hlr_10.42.42.2(pid=9003): Launched 13:12:00.218957 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:00.761521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9005): Launched 13:12:01.111329 run osmo-stp_10.42.42.5(pid=9006): Launched 13:12:01.387021 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:12:01.954016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9008): Launched 13:12:02.094448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:12:02.380185 run patchelf(pid=9009): Launched 13:12:02.562876 run osmo-stp_10.42.42.5(pid=9006): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9006)] 13:12:02.702099 run osmo-stp_10.42.42.5(pid=9006): stdout: | (launched: 2022-12-09_13:12:01.040323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:02.843755 run osmo-stp_10.42.42.5(pid=9006): stderr: | 20221209131201230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131201230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131201231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131201231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131201231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131201232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131201232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:02.984116 run osmo-stp_10.42.42.5(pid=9006): stdout: | (launched: 2022-12-09_13:12:01.040323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:03.119462 run osmo-stp_10.42.42.5(pid=9006): stderr: | 20221209131201230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131201230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131201231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131201231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131201231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131201232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131201232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:03.279318 run patchelf(pid=9009): Terminating (SIGINT) 13:12:03.462239 run patchelf(pid=9009): Terminated: ok {rc=0} 13:12:03.594100 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9006): Process ended prematurely: osmo-stp_10.42.42.5(pid=9006) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9006)] [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:12:03.604208 tst iperf3m4.py:8: Test FAILED (11.2 sec) 13:12:03.633622 run osmo-hlr_10.42.42.2(pid=9003): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9003)] 13:12:03.684041 run osmo-hlr_10.42.42.2(pid=9003): stdout: | (launched: 2022-12-09_13:12:00.043463) 13:12:03.736176 run osmo-hlr_10.42.42.2(pid=9003): stderr: | 20221209131200218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131200218 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131200218 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131200218 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131200218 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131200218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131200230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131200239 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131200239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131200239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:03.789253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8992): Terminating (SIGTERM) 13:12:03.831865 run iperf3-srv_10.42.42.10(pid=8993): Terminating (SIGTERM) 13:12:03.874335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8994): Terminating (SIGTERM) 13:12:03.916807 run iperf3-srv_10.42.42.10(pid=8995): Terminating (SIGTERM) 13:12:03.959230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8996): Terminating (SIGTERM) 13:12:04.001821 run iperf3-srv_10.42.42.10(pid=8997): Terminating (SIGTERM) 13:12:04.043997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8998): Terminating (SIGTERM) 13:12:04.086435 run iperf3-srv_10.42.42.10(pid=8999): Terminating (SIGTERM) 13:12:04.128573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9002): Terminating (SIGTERM) 13:12:04.170971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9005): Terminating (SIGTERM) 13:12:04.213791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9008): Terminating (SIGTERM) 13:12:04.256690 --- ParallelTerminationStrategy: PID 8992 died... 13:12:04.276663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8992): Terminated: ok {rc=0} 13:12:04.323741 --- ParallelTerminationStrategy: PID 8993 died... 13:12:04.343636 run iperf3-srv_10.42.42.10(pid=8993): Terminated {rc=256} 13:12:04.390681 --- ParallelTerminationStrategy: PID 8994 died... 13:12:04.410585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8994): Terminated: ok {rc=0} 13:12:04.457556 --- ParallelTerminationStrategy: PID 8995 died... 13:12:04.477251 run iperf3-srv_10.42.42.10(pid=8995): Terminated {rc=256} 13:12:04.523854 --- ParallelTerminationStrategy: PID 8996 died... 13:12:04.543545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8996): Terminated: ok {rc=0} 13:12:04.590271 --- ParallelTerminationStrategy: PID 8997 died... 13:12:04.609969 run iperf3-srv_10.42.42.10(pid=8997): Terminated {rc=256} 13:12:04.656612 --- ParallelTerminationStrategy: PID 8998 died... 13:12:04.676416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8998): Terminated: ok {rc=0} 13:12:04.723182 --- ParallelTerminationStrategy: PID 8999 died... 13:12:04.742926 run iperf3-srv_10.42.42.10(pid=8999): Terminated {rc=256} 13:12:04.789762 --- ParallelTerminationStrategy: PID 9002 died... 13:12:04.809592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9002): Terminated: ok {rc=0} 13:12:04.856487 --- ParallelTerminationStrategy: PID 9005 died... 13:12:04.876319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9005): Terminated: ok {rc=0} 13:12:04.923182 --- ParallelTerminationStrategy: PID 9008 died... 13:12:04.942965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9008): Terminated: ok {rc=0} 13:12:05.031542 bus /gobi_4: Setting Powered False 13:12:06.131733 bus /gobi_4: Setting Powered False 13:12:07.249829 bus /gobi_1: Setting Powered False 13:12:08.348630 bus /gobi_1: Setting Powered False 13:12:09.464633 bus /gobi_0: Setting Powered False 13:12:10.564308 bus /gobi_0: Setting Powered False 13:12:11.679479 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:12:12.782601 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:12:12.794715 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:12:12.868792 tst ping.py: using LAC 21690 13:12:12.992028 tst ping.py: using RAC 15 13:12:13.121755 tst ping.py: using CellId 21690 13:12:13.241508 tst ping.py: using BVCI 21691 13:12:13.351043 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:12:13.362515 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:12:13.373442 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:12:13.384234 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:12:13.394959 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:12:13.405765 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:12:13.416629 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:12:13.427592 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:12:13.542578 tst ping.py:19: start network... 13:12:13.743653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:14.211132 run create_hlr_db(pid=9010): Launched 13:12:14.336267 bus /gobi_6: Setting Powered False 13:12:15.396364 run create_hlr_db(pid=9010): Terminated: ok {rc=0} 13:12:15.856281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9012): Launched 13:12:16.217790 run osmo-hlr_10.42.42.2(pid=9013): Launched 13:12:16.443900 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:17.105715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9015): Launched 13:12:17.417593 run osmo-stp_10.42.42.5(pid=9016): Launched 13:12:17.534779 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:12:18.057682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9018): Launched 13:12:18.172602 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:12:18.428367 run patchelf(pid=9019): Launched 13:12:18.595824 run osmo-stp_10.42.42.5(pid=9016): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9016)] 13:12:18.722891 run osmo-stp_10.42.42.5(pid=9016): stdout: | (launched: 2022-12-09_13:12:17.361828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:18.851463 run osmo-stp_10.42.42.5(pid=9016): stderr: | 20221209131217531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131217531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131217532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131217532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131217532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131217533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131217533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:18.979779 run osmo-stp_10.42.42.5(pid=9016): stdout: | (launched: 2022-12-09_13:12:17.361828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:19.102523 run osmo-stp_10.42.42.5(pid=9016): stderr: | 20221209131217531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131217531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131217532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131217532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131217532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131217533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131217533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:19.247976 run patchelf(pid=9019): Terminating (SIGINT) 13:12:19.415684 run patchelf(pid=9019): Terminated: ok {rc=0} 13:12:19.536502 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9016): Process ended prematurely: osmo-stp_10.42.42.5(pid=9016) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9016)] [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 13:12:19.545369 tst ping.py:22: Test FAILED (6.8 sec) 13:12:19.571751 run osmo-hlr_10.42.42.2(pid=9013): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9013)] 13:12:19.618790 run osmo-hlr_10.42.42.2(pid=9013): stdout: | (launched: 2022-12-09_13:12:16.155985) 13:12:19.667360 run osmo-hlr_10.42.42.2(pid=9013): stderr: | 20221209131216364 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131216364 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131216364 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131216364 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131216364 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131216364 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131216381 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131216404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131216404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131216404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:19.716804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9012): Terminating (SIGTERM) 13:12:19.756273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9015): Terminating (SIGTERM) 13:12:19.795510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9018): Terminating (SIGTERM) 13:12:19.835641 --- ParallelTerminationStrategy: PID 9012 died... 13:12:19.854691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9012): Terminated: ok {rc=0} 13:12:19.897814 --- ParallelTerminationStrategy: PID 9015 died... 13:12:19.916083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9015): Terminated: ok {rc=0} 13:12:19.959016 --- ParallelTerminationStrategy: PID 9018 died... 13:12:19.977374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9018): Terminated: ok {rc=0} 13:12:20.062148 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:12:21.150394 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:12:21.162395 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:12:21.233426 tst ping_idle_ping.py: using LAC 21691 13:12:21.353662 tst ping_idle_ping.py: using RAC 16 13:12:21.472107 tst ping_idle_ping.py: using CellId 21691 13:12:21.591905 tst ping_idle_ping.py: using BVCI 21692 13:12:21.701457 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:12:21.712296 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:12:21.723030 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:12:21.733777 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:12:21.744366 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:12:21.755117 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:12:21.765951 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:12:21.776705 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:12:21.894684 tst ping_idle_ping.py:24: start network... 13:12:22.114129 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:22.618394 run create_hlr_db(pid=9020): Launched 13:12:22.742687 bus /gobi_6: Setting Powered False 13:12:23.806637 run create_hlr_db(pid=9020): Terminated: ok {rc=0} 13:12:24.239022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9022): Launched 13:12:24.542702 run osmo-hlr_10.42.42.2(pid=9023): Launched 13:12:24.658824 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:25.193651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9025): Launched 13:12:25.496205 run osmo-stp_10.42.42.5(pid=9026): Launched 13:12:25.611750 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:12:26.133653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9028): Launched 13:12:26.248528 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:12:26.504300 run patchelf(pid=9029): Launched 13:12:26.672678 run osmo-stp_10.42.42.5(pid=9026): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9026)] 13:12:26.801087 run osmo-stp_10.42.42.5(pid=9026): stdout: | (launched: 2022-12-09_13:12:25.439994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:26.930906 run osmo-stp_10.42.42.5(pid=9026): stderr: | 20221209131225608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131225608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131225609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131225609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131225610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131225610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131225610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:27.060550 run osmo-stp_10.42.42.5(pid=9026): stdout: | (launched: 2022-12-09_13:12:25.439994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:27.185498 run osmo-stp_10.42.42.5(pid=9026): stderr: | 20221209131225608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131225608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131225609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131225609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131225610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131225610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131225610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:27.332306 run patchelf(pid=9029): Terminating (SIGINT) 13:12:27.501959 run patchelf(pid=9029): Terminated: ok {rc=0} 13:12:27.623336 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9026): Process ended prematurely: osmo-stp_10.42.42.5(pid=9026) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9026)] [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:12:27.632204 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:12:27.658548 run osmo-hlr_10.42.42.2(pid=9023): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9023)] 13:12:27.705649 run osmo-hlr_10.42.42.2(pid=9023): stdout: | (launched: 2022-12-09_13:12:24.486898) 13:12:27.754334 run osmo-hlr_10.42.42.2(pid=9023): stderr: | 20221209131224663 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131224663 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131224663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131224663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131224663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131224664 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131224676 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131224686 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131224687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131224687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:27.803634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9022): Terminating (SIGTERM) 13:12:27.842924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9025): Terminating (SIGTERM) 13:12:27.882367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9028): Terminating (SIGTERM) 13:12:27.921793 --- ParallelTerminationStrategy: PID 9022 died... 13:12:27.940511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9022): Terminated: ok {rc=0} 13:12:27.984159 --- ParallelTerminationStrategy: PID 9025 died... 13:12:28.002684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9025): Terminated: ok {rc=0} 13:12:28.045844 --- ParallelTerminationStrategy: PID 9028 died... 13:12:28.064197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9028): Terminated: ok {rc=0} 13:12:28.146596 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:12:29.458826 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:12:29.466313 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:12:29.503180 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 13:12:29.543619 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 13:12:29.635105 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:12:29.670101 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 13:12:29.710415 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 13:12:30.308852 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 13:12:30.362846 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:30.374620 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:12:30.429397 tst cs_paging_gprs_active.py: using LAC 21692 13:12:30.560775 tst cs_paging_gprs_active.py: using RAC 17 13:12:30.684557 tst cs_paging_gprs_active.py: using CellId 21692 13:12:30.806881 tst cs_paging_gprs_active.py: using BVCI 21693 13:12:30.921385 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:30.933127 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:30.944655 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:30.956366 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:30.968667 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:30.980711 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:30.992827 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:31.004594 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:31.016655 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:12:31.169168 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:12:31.296497 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:12:31.538886 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:12:31.857767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9035): Launched 13:12:32.145065 run iperf3-srv_10.42.42.10(pid=9036): Launched 13:12:32.284117 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:12:32.510570 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:12:32.843007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9037): Launched 13:12:33.130418 run iperf3-srv_10.42.42.10(pid=9038): Launched 13:12:33.254533 tst cs_paging_gprs_active.py:38: start network... 13:12:33.477423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:33.962208 run create_hlr_db(pid=9039): Launched 13:12:34.088048 bus /gobi_6: Setting Powered False 13:12:35.148417 run create_hlr_db(pid=9039): Terminated: ok {rc=0} 13:12:35.594684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9041): Launched 13:12:35.905944 run osmo-hlr_10.42.42.2(pid=9044): Launched 13:12:36.022898 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:36.551409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9046): Launched 13:12:36.858855 run osmo-stp_10.42.42.5(pid=9047): Launched 13:12:36.976284 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:12:37.506810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9049): Launched 13:12:37.625743 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:12:37.885444 run patchelf(pid=9050): Launched 13:12:38.056004 run osmo-stp_10.42.42.5(pid=9047): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9047)] 13:12:38.185657 run osmo-stp_10.42.42.5(pid=9047): stdout: | (launched: 2022-12-09_13:12:36.802327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:38.316645 run osmo-stp_10.42.42.5(pid=9047): stderr: | 20221209131236970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131236971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131236971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131236971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131236972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131236972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131236972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:38.448056 run osmo-stp_10.42.42.5(pid=9047): stdout: | (launched: 2022-12-09_13:12:36.802327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:38.574199 run osmo-stp_10.42.42.5(pid=9047): stderr: | 20221209131236970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131236971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131236971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131236971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131236972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131236972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131236972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:38.723223 run patchelf(pid=9050): Terminating (SIGINT) 13:12:38.894738 run patchelf(pid=9050): Terminated: ok {rc=0} 13:12:39.017953 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9047): Process ended prematurely: osmo-stp_10.42.42.5(pid=9047) [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9047)] [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 13:12:39.027325 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:12:39.054153 run osmo-hlr_10.42.42.2(pid=9044): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9044)] 13:12:39.101267 run osmo-hlr_10.42.42.2(pid=9044): stdout: | (launched: 2022-12-09_13:12:35.849524) 13:12:39.150206 run osmo-hlr_10.42.42.2(pid=9044): stderr: | 20221209131236027 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131236027 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131236027 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131236027 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131236027 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131236027 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131236040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131236051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131236051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131236051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:39.199894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9035): Terminating (SIGTERM) 13:12:39.239362 run iperf3-srv_10.42.42.10(pid=9036): Terminating (SIGTERM) 13:12:39.278673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9037): Terminating (SIGTERM) 13:12:39.318093 run iperf3-srv_10.42.42.10(pid=9038): Terminating (SIGTERM) 13:12:39.357321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9041): Terminating (SIGTERM) 13:12:39.397077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9046): Terminating (SIGTERM) 13:12:39.436211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9049): Terminating (SIGTERM) 13:12:39.475684 --- ParallelTerminationStrategy: PID 9035 died... 13:12:39.494522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9035): Terminated: ok {rc=0} 13:12:39.538204 --- ParallelTerminationStrategy: PID 9036 died... 13:12:39.556604 run iperf3-srv_10.42.42.10(pid=9036): Terminated {rc=256} 13:12:39.600060 --- ParallelTerminationStrategy: PID 9037 died... 13:12:39.618559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9037): Terminated: ok {rc=0} 13:12:39.661734 --- ParallelTerminationStrategy: PID 9038 died... 13:12:39.680050 run iperf3-srv_10.42.42.10(pid=9038): Terminated {rc=256} 13:12:39.723262 --- ParallelTerminationStrategy: PID 9041 died... 13:12:39.741607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9041): Terminated: ok {rc=0} 13:12:39.785349 --- ParallelTerminationStrategy: PID 9046 died... 13:12:39.803996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9046): Terminated: ok {rc=0} 13:12:39.847785 --- ParallelTerminationStrategy: PID 9049 died... 13:12:39.866541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9049): Terminated: ok {rc=0} 13:12:39.952116 bus /gobi_0: Setting Powered False 13:12:41.053591 bus /gobi_0: Setting Powered False 13:12:42.170532 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 13:12:43.317710 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:43.330012 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:12:43.384704 tst iperf3.py: using LAC 21693 13:12:43.507346 tst iperf3.py: using RAC 18 13:12:43.630341 tst iperf3.py: using CellId 21693 13:12:43.752870 tst iperf3.py: using BVCI 21694 13:12:43.866550 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:43.878026 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:43.889052 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:43.900080 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:43.911042 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:43.922197 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:43.933334 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:43.944195 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:43.955276 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:12:44.070436 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:12:44.277309 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:12:44.587861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9051): Launched 13:12:44.856942 run iperf3-srv_10.42.42.10(pid=9052): Launched 13:12:44.972875 tst iperf3.py:8: start network... 13:12:45.179334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:45.658408 run create_hlr_db(pid=9053): Launched 13:12:45.783876 bus /gobi_6: Setting Powered False 13:12:46.845552 run create_hlr_db(pid=9053): Terminated: ok {rc=0} 13:12:47.306713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9055): Launched 13:12:47.615195 run osmo-hlr_10.42.42.2(pid=9056): Launched 13:12:47.732271 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:48.262342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9058): Launched 13:12:48.569529 run osmo-stp_10.42.42.5(pid=9059): Launched 13:12:48.687646 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:12:49.218636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9061): Launched 13:12:49.335895 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:12:49.596042 run patchelf(pid=9062): Launched 13:12:49.766702 run osmo-stp_10.42.42.5(pid=9059): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9059)] 13:12:49.896736 run osmo-stp_10.42.42.5(pid=9059): stdout: | (launched: 2022-12-09_13:12:48.512516) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:50.028155 run osmo-stp_10.42.42.5(pid=9059): stderr: | 20221209131248683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131248683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131248684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131248684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131248685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131248685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131248685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:50.159443 run osmo-stp_10.42.42.5(pid=9059): stdout: | (launched: 2022-12-09_13:12:48.512516) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:50.285512 run osmo-stp_10.42.42.5(pid=9059): stderr: | 20221209131248683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131248683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131248684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131248684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131248685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131248685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131248685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:50.435148 run patchelf(pid=9062): Terminating (SIGINT) 13:12:50.607475 run patchelf(pid=9062): Terminated: ok {rc=0} 13:12:50.731441 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9059): Process ended prematurely: osmo-stp_10.42.42.5(pid=9059) [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9059)] [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 13:12:50.740821 tst iperf3.py:8: Test FAILED (7.5 sec) 13:12:50.767722 run osmo-hlr_10.42.42.2(pid=9056): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9056)] 13:12:50.815291 run osmo-hlr_10.42.42.2(pid=9056): stdout: | (launched: 2022-12-09_13:12:47.557508) 13:12:50.864011 run osmo-hlr_10.42.42.2(pid=9056): stderr: | 20221209131247736 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131247736 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131247737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131247737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131247737 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131247737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131247749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131247758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131247758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131247758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:50.913296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9051): Terminating (SIGTERM) 13:12:50.952643 run iperf3-srv_10.42.42.10(pid=9052): Terminating (SIGTERM) 13:12:50.991701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9055): Terminating (SIGTERM) 13:12:51.030948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9058): Terminating (SIGTERM) 13:12:51.070264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9061): Terminating (SIGTERM) 13:12:51.109844 --- ParallelTerminationStrategy: PID 9051 died... 13:12:51.128907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9051): Terminated: ok {rc=0} 13:12:51.172384 --- ParallelTerminationStrategy: PID 9052 died... 13:12:51.190741 run iperf3-srv_10.42.42.10(pid=9052): Terminated {rc=256} 13:12:51.233721 --- ParallelTerminationStrategy: PID 9055 died... 13:12:51.252132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9055): Terminated: ok {rc=0} 13:12:51.295272 --- ParallelTerminationStrategy: PID 9058 died... 13:12:51.313634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9058): Terminated: ok {rc=0} 13:12:51.356702 --- ParallelTerminationStrategy: PID 9061 died... 13:12:51.375143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9061): Terminated: ok {rc=0} 13:12:51.459997 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 13:12:52.611537 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:52.624479 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:12:52.680600 tst iperf3m4.py: using LAC 21694 13:12:52.809266 tst iperf3m4.py: using RAC 19 13:12:52.943134 tst iperf3m4.py: using CellId 21694 13:12:53.072767 tst iperf3m4.py: using BVCI 21695 13:12:53.193236 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:53.205235 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:53.216938 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:53.229189 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:53.241297 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:53.253485 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:53.265968 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:53.277950 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:12:53.290504 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:12:53.412171 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:12:53.532404 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:12:53.653335 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:12:53.773518 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:12:53.980299 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:12:54.289786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9063): Launched 13:12:54.558579 run iperf3-srv_10.42.42.10(pid=9064): Launched 13:12:54.675209 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:12:54.881117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:12:55.191044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9065): Launched 13:12:55.459209 run iperf3-srv_10.42.42.10(pid=9066): Launched 13:12:55.574723 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:12:55.780668 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:12:56.090213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9067): Launched 13:12:56.360330 run iperf3-srv_10.42.42.10(pid=9068): Launched 13:12:56.475985 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:12:56.682285 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:12:56.991054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9069): Launched 13:12:57.259163 run iperf3-srv_10.42.42.10(pid=9070): Launched 13:12:57.374476 tst iperf3m4.py:8: start network... 13:12:57.580064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:58.056797 run create_hlr_db(pid=9071): Launched 13:12:58.182838 bus /gobi_6: Setting Powered False 13:12:59.243850 run create_hlr_db(pid=9071): Terminated: ok {rc=0} 13:12:59.691134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9073): Launched 13:13:00.022065 run osmo-hlr_10.42.42.2(pid=9074): Launched 13:13:00.149332 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:00.723359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9076): Launched 13:13:01.101694 run osmo-stp_10.42.42.5(pid=9077): Launched 13:13:01.385838 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:13:01.997311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9079): Launched 13:13:02.156167 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:13:02.437712 run patchelf(pid=9080): Launched 13:13:02.620530 run osmo-stp_10.42.42.5(pid=9077): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9077)] 13:13:02.759758 run osmo-stp_10.42.42.5(pid=9077): stdout: | (launched: 2022-12-09_13:13:01.034854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:02.901473 run osmo-stp_10.42.42.5(pid=9077): stderr: | 20221209131301260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131301260 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131301260 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131301261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131301273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131301273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131301273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:03.042085 run osmo-stp_10.42.42.5(pid=9077): stdout: | (launched: 2022-12-09_13:13:01.034854) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:03.177482 run osmo-stp_10.42.42.5(pid=9077): stderr: | 20221209131301260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131301260 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131301260 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131301261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131301273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131301273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131301273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:03.338006 run patchelf(pid=9080): Terminating (SIGINT) 13:13:03.521573 run patchelf(pid=9080): Terminated: ok {rc=0} 13:13:03.654180 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9077): Process ended prematurely: osmo-stp_10.42.42.5(pid=9077) [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9077)] [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 13:13:03.664478 tst iperf3m4.py:8: Test FAILED (11.1 sec) 13:13:03.694267 run osmo-hlr_10.42.42.2(pid=9074): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9074)] 13:13:03.745167 run osmo-hlr_10.42.42.2(pid=9074): stdout: | (launched: 2022-12-09_13:12:59.961731) 13:13:03.798197 run osmo-hlr_10.42.42.2(pid=9074): stderr: | 20221209131300157 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131300157 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131300157 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131300157 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131300157 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131300157 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131300170 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131300179 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131300179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131300179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:03.851356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9063): Terminating (SIGTERM) 13:13:03.893709 run iperf3-srv_10.42.42.10(pid=9064): Terminating (SIGTERM) 13:13:03.936274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9065): Terminating (SIGTERM) 13:13:03.978831 run iperf3-srv_10.42.42.10(pid=9066): Terminating (SIGTERM) 13:13:04.021099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9067): Terminating (SIGTERM) 13:13:04.063532 run iperf3-srv_10.42.42.10(pid=9068): Terminating (SIGTERM) 13:13:04.105840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9069): Terminating (SIGTERM) 13:13:04.147947 run iperf3-srv_10.42.42.10(pid=9070): Terminating (SIGTERM) 13:13:04.190015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9073): Terminating (SIGTERM) 13:13:04.232230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9076): Terminating (SIGTERM) 13:13:04.274406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9079): Terminating (SIGTERM) 13:13:04.316931 --- ParallelTerminationStrategy: PID 9063 died... 13:13:04.336795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9063): Terminated: ok {rc=0} 13:13:04.383604 --- ParallelTerminationStrategy: PID 9064 died... 13:13:04.403206 run iperf3-srv_10.42.42.10(pid=9064): Terminated {rc=256} 13:13:04.449614 --- ParallelTerminationStrategy: PID 9065 died... 13:13:04.469410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9065): Terminated: ok {rc=0} 13:13:04.516025 --- ParallelTerminationStrategy: PID 9066 died... 13:13:04.535780 run iperf3-srv_10.42.42.10(pid=9066): Terminated {rc=256} 13:13:04.582877 --- ParallelTerminationStrategy: PID 9067 died... 13:13:04.602560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9067): Terminated: ok {rc=0} 13:13:04.649111 --- ParallelTerminationStrategy: PID 9068 died... 13:13:04.668719 run iperf3-srv_10.42.42.10(pid=9068): Terminated {rc=256} 13:13:04.715176 --- ParallelTerminationStrategy: PID 9069 died... 13:13:04.734939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9069): Terminated: ok {rc=0} 13:13:04.781817 --- ParallelTerminationStrategy: PID 9070 died... 13:13:04.801380 run iperf3-srv_10.42.42.10(pid=9070): Terminated {rc=256} 13:13:04.848554 --- ParallelTerminationStrategy: PID 9073 died... 13:13:04.868284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9073): Terminated: ok {rc=0} 13:13:04.914797 --- ParallelTerminationStrategy: PID 9076 died... 13:13:04.934623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9076): Terminated: ok {rc=0} 13:13:04.980910 --- ParallelTerminationStrategy: PID 9079 died... 13:13:05.000589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9079): Terminated: ok {rc=0} 13:13:05.088761 bus /gobi_4: Setting Powered False 13:13:06.184177 bus /gobi_4: Setting Powered False 13:13:07.299744 bus /gobi_1: Setting Powered False 13:13:08.398596 bus /gobi_1: Setting Powered False 13:13:09.514585 bus /gobi_0: Setting Powered False 13:13:10.615265 bus /gobi_0: Setting Powered False 13:13:11.732735 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 13:13:12.834088 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:13:12.846942 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:13:12.905671 tst ping.py: using LAC 21695 13:13:13.024743 tst ping.py: using RAC 20 13:13:13.141726 tst ping.py: using CellId 21695 13:13:13.267468 tst ping.py: using BVCI 21696 13:13:13.384384 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:13:13.396423 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:13:13.408241 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:13:13.420192 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:13:13.431908 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:13:13.444385 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:13:13.456567 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:13:13.468590 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:13:13.585553 tst ping.py:19: start network... 13:13:13.787033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:14.253476 run create_hlr_db(pid=9081): Launched 13:13:14.376533 bus /gobi_6: Setting Powered False 13:13:15.436933 run create_hlr_db(pid=9081): Terminated: ok {rc=0} 13:13:15.861681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9083): Launched 13:13:16.211860 run osmo-hlr_10.42.42.2(pid=9084): Launched 13:13:16.444709 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:17.153328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9086): Launched 13:13:17.493187 run osmo-stp_10.42.42.5(pid=9087): Launched 13:13:17.617332 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:13:18.175755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9089): Launched 13:13:18.300760 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:13:18.573983 run patchelf(pid=9090): Launched 13:13:18.755615 run osmo-stp_10.42.42.5(pid=9087): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9087)] 13:13:18.894051 run osmo-stp_10.42.42.5(pid=9087): stdout: | (launched: 2022-12-09_13:13:17.433663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:19.033472 run osmo-stp_10.42.42.5(pid=9087): stderr: | 20221209131317623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131317623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131317624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131317624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131317624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131317625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131317625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:19.172305 run osmo-stp_10.42.42.5(pid=9087): stdout: | (launched: 2022-12-09_13:13:17.433663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:19.305688 run osmo-stp_10.42.42.5(pid=9087): stderr: | 20221209131317623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131317623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131317624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131317624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131317624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131317625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131317625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:19.463496 run patchelf(pid=9090): Terminating (SIGINT) 13:13:19.645102 run patchelf(pid=9090): Terminated: ok {rc=0} 13:13:19.775836 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9087): Process ended prematurely: osmo-stp_10.42.42.5(pid=9087) [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9087)] [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 13:13:19.785985 tst ping.py:22: Test FAILED (6.9 sec) 13:13:19.814629 run osmo-hlr_10.42.42.2(pid=9084): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9084)] 13:13:19.865581 run osmo-hlr_10.42.42.2(pid=9084): stdout: | (launched: 2022-12-09_13:13:16.150327) 13:13:19.917647 run osmo-hlr_10.42.42.2(pid=9084): stderr: | 20221209131316420 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131316420 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131316420 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131316420 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131316420 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131316420 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131316435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131316455 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131316455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131316455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:19.970667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9083): Terminating (SIGTERM) 13:13:20.013294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9086): Terminating (SIGTERM) 13:13:20.056014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9089): Terminating (SIGTERM) 13:13:20.098900 --- ParallelTerminationStrategy: PID 9083 died... 13:13:20.118914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9083): Terminated: ok {rc=0} 13:13:20.166169 --- ParallelTerminationStrategy: PID 9086 died... 13:13:20.185942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9086): Terminated: ok {rc=0} 13:13:20.232633 --- ParallelTerminationStrategy: PID 9089 died... 13:13:20.252373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9089): Terminated: ok {rc=0} 13:13:20.340586 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 13:13:21.429844 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:13:21.444627 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:13:21.495843 tst ping_idle_ping.py: using LAC 21696 13:13:21.615016 tst ping_idle_ping.py: using RAC 21 13:13:21.736475 tst ping_idle_ping.py: using CellId 21696 13:13:21.857168 tst ping_idle_ping.py: using BVCI 21697 13:13:21.966515 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:13:21.978152 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:13:21.989460 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:13:22.000756 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:13:22.011975 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:13:22.023336 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:13:22.034780 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:13:22.045956 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:13:22.164327 tst ping_idle_ping.py:24: start network... 13:13:22.384058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:22.890518 run create_hlr_db(pid=9091): Launched 13:13:23.015973 bus /gobi_6: Setting Powered False 13:13:24.080440 run create_hlr_db(pid=9091): Terminated: ok {rc=0} 13:13:24.513641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9093): Launched 13:13:24.816629 run osmo-hlr_10.42.42.2(pid=9094): Launched 13:13:24.932720 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:25.456095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9096): Launched 13:13:25.758914 run osmo-stp_10.42.42.5(pid=9097): Launched 13:13:25.874050 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:13:26.396468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9099): Launched 13:13:26.511978 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:13:26.768125 run patchelf(pid=9100): Launched 13:13:26.937263 run osmo-stp_10.42.42.5(pid=9097): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9097)] 13:13:27.065443 run osmo-stp_10.42.42.5(pid=9097): stdout: | (launched: 2022-12-09_13:13:25.703094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:27.195169 run osmo-stp_10.42.42.5(pid=9097): stderr: | 20221209131325873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131325873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131325874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131325874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131325874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131325875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131325875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:27.324719 run osmo-stp_10.42.42.5(pid=9097): stdout: | (launched: 2022-12-09_13:13:25.703094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:27.448526 run osmo-stp_10.42.42.5(pid=9097): stderr: | 20221209131325873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131325873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131325874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131325874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131325874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131325875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131325875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:27.595436 run patchelf(pid=9100): Terminating (SIGINT) 13:13:27.764206 run patchelf(pid=9100): Terminated: ok {rc=0} 13:13:27.886523 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9097): Process ended prematurely: osmo-stp_10.42.42.5(pid=9097) [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9097)] [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 13:13:27.895558 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:13:27.922226 run osmo-hlr_10.42.42.2(pid=9094): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9094)] 13:13:27.969794 run osmo-hlr_10.42.42.2(pid=9094): stdout: | (launched: 2022-12-09_13:13:24.760693) 13:13:28.019049 run osmo-hlr_10.42.42.2(pid=9094): stderr: | 20221209131324938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131324938 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131324938 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131324938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131324938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131324938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131324950 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131324959 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131324959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131324959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:28.068663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9093): Terminating (SIGTERM) 13:13:28.108299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9096): Terminating (SIGTERM) 13:13:28.147800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9099): Terminating (SIGTERM) 13:13:28.187570 --- ParallelTerminationStrategy: PID 9093 died... 13:13:28.206338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9093): Terminated: ok {rc=0} 13:13:28.249957 --- ParallelTerminationStrategy: PID 9096 died... 13:13:28.268528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9096): Terminated: ok {rc=0} 13:13:28.312179 --- ParallelTerminationStrategy: PID 9099 died... 13:13:28.330802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9099): Terminated: ok {rc=0} 13:13:28.415519 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:13:29.726184 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:13:29.733310 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:13:29.767157 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:13:29.802034 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:13:29.853962 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:13:29.887282 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:13:29.921978 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:13:30.481393 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2360 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:13:30.486582 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:13:30.498084 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:13:30.567019 tst switch_tch_pdch.py: using LAC 21697 13:13:30.683901 tst switch_tch_pdch.py: using RAC 22 13:13:30.800690 tst switch_tch_pdch.py: using CellId 21697 13:13:30.941276 tst switch_tch_pdch.py: using BVCI 21698 13:13:31.065176 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:13:31.078212 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:13:31.092652 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:13:31.107326 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:13:31.121302 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:13:31.135048 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:13:31.148821 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:13:31.162147 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:13:31.285656 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:13:31.403897 tst switch_tch_pdch.py:51: start network... 13:13:31.610287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:32.086910 run create_hlr_db(pid=9104): Launched 13:13:32.245668 bus /gobi_6: Setting Powered False 13:13:33.305671 run create_hlr_db(pid=9104): Terminated: ok {rc=0} 13:13:33.726735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9106): Launched 13:13:34.028848 run osmo-hlr_10.42.42.2(pid=9107): Launched 13:13:34.143141 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:34.697173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9109): Launched 13:13:35.021539 run osmo-stp_10.42.42.5(pid=9110): Launched 13:13:35.144344 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:13:35.702220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9112): Launched 13:13:35.827454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:13:36.101371 run patchelf(pid=9113): Launched 13:13:36.280632 run osmo-stp_10.42.42.5(pid=9110): ERR: Terminated: ERROR {rc=1} [trial-2360↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9110)] 13:13:36.417303 run osmo-stp_10.42.42.5(pid=9110): stdout: | (launched: 2022-12-09_13:13:34.961310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:36.555807 run osmo-stp_10.42.42.5(pid=9110): stderr: | 20221209131335155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131335155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131335155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131335156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131335156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131335156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131335156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:36.694318 run osmo-stp_10.42.42.5(pid=9110): stdout: | (launched: 2022-12-09_13:13:34.961310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:36.827022 run osmo-stp_10.42.42.5(pid=9110): stderr: | 20221209131335155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131335155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131335155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131335156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131335156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131335156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131335156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:36.983972 run patchelf(pid=9113): Terminating (SIGINT) 13:13:37.164096 run patchelf(pid=9113): Terminated: ok {rc=0} 13:13:37.293965 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9110): Process ended prematurely: osmo-stp_10.42.42.5(pid=9110) [trial-2360↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9110)] [trial-2360↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:13:37.303612 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 13:13:37.332423 run osmo-hlr_10.42.42.2(pid=9107): ERR: Terminated: ERROR {rc=237} [trial-2360↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9107)] 13:13:37.382992 run osmo-hlr_10.42.42.2(pid=9107): stdout: | (launched: 2022-12-09_13:13:33.973085) 13:13:37.435133 run osmo-hlr_10.42.42.2(pid=9107): stderr: | 20221209131334151 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131334151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131334151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131334151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131334151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131334151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131334163 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131334171 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131334171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131334171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:37.487810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9106): Terminating (SIGTERM) 13:13:37.530211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9109): Terminating (SIGTERM) 13:13:37.572553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9112): Terminating (SIGTERM) 13:13:37.615312 --- ParallelTerminationStrategy: PID 9106 died... 13:13:37.635546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9106): Terminated: ok {rc=0} 13:13:37.682638 --- ParallelTerminationStrategy: PID 9109 died... 13:13:37.702536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9109): Terminated: ok {rc=0} 13:13:37.749414 --- ParallelTerminationStrategy: PID 9112 died... 13:13:37.769168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9112): Terminated: ok {rc=0} 13:13:37.857606 bus /gobi_0: Setting Powered False 13:13:38.956739 bus /gobi_0: Setting Powered False 13:13:40.073680 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:13:41.326449 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:13:41.332244 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:13:41.365769 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:13:41.400747 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:13:41.454975 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:13:41.489442 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:13:41.523921 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:13:42.075875 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2360 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:13:42.081270 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:13:42.092378 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:13:42.161647 tst switch_tch_pdch.py: using LAC 21698 13:13:42.282694 tst switch_tch_pdch.py: using RAC 23 13:13:42.403644 tst switch_tch_pdch.py: using CellId 21698 13:13:42.523616 tst switch_tch_pdch.py: using BVCI 21699 13:13:42.633167 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:13:42.644075 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:13:42.654803 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:13:42.665746 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:13:42.676583 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:13:42.687507 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:13:42.698378 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:13:42.709842 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:13:42.829263 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:13:42.948384 tst switch_tch_pdch.py:51: start network... 13:13:43.165804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:43.637424 run create_hlr_db(pid=9118): Launched 13:13:43.762197 bus /gobi_6: Setting Powered False 13:13:44.826370 run create_hlr_db(pid=9118): Terminated: ok {rc=0} 13:13:45.233742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9120): Launched 13:13:45.535430 run osmo-hlr_10.42.42.2(pid=9121): Launched 13:13:45.650457 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:46.169794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9123): Launched 13:13:46.491910 run osmo-stp_10.42.42.5(pid=9124): Launched 13:13:46.789095 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:13:47.329506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9126): Launched 13:13:47.453303 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:13:47.725649 run patchelf(pid=9127): Launched 13:13:47.905282 run osmo-stp_10.42.42.5(pid=9124): ERR: Terminated: ERROR {rc=1} [trial-2360↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9124)] 13:13:48.041459 run osmo-stp_10.42.42.5(pid=9124): stdout: | (launched: 2022-12-09_13:13:46.433585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:48.179070 run osmo-stp_10.42.42.5(pid=9124): stderr: | 20221209131346669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131346669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131346670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131346670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131346671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131346671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131346671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:48.317033 run osmo-stp_10.42.42.5(pid=9124): stdout: | (launched: 2022-12-09_13:13:46.433585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:48.449118 run osmo-stp_10.42.42.5(pid=9124): stderr: | 20221209131346669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131346669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131346670 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131346670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131346671 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131346671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131346671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:48.605520 run patchelf(pid=9127): Terminating (SIGINT) 13:13:48.785026 run patchelf(pid=9127): Terminated: ok {rc=0} 13:13:48.915323 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9124): Process ended prematurely: osmo-stp_10.42.42.5(pid=9124) [trial-2360↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9124)] [trial-2360↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:13:48.924816 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 13:13:48.953347 run osmo-hlr_10.42.42.2(pid=9121): ERR: Terminated: ERROR {rc=237} [trial-2360↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9121)] 13:13:49.003483 run osmo-hlr_10.42.42.2(pid=9121): stdout: | (launched: 2022-12-09_13:13:45.479701) 13:13:49.055358 run osmo-hlr_10.42.42.2(pid=9121): stderr: | 20221209131345656 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131345656 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131345656 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131345656 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131345656 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131345656 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131345682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131345692 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131345692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131345692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:49.107941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9120): Terminating (SIGTERM) 13:13:49.149971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9123): Terminating (SIGTERM) 13:13:49.191897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9126): Terminating (SIGTERM) 13:13:49.234070 --- ParallelTerminationStrategy: PID 9120 died... 13:13:49.254001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9120): Terminated: ok {rc=0} 13:13:49.300559 --- ParallelTerminationStrategy: PID 9123 died... 13:13:49.320235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9123): Terminated: ok {rc=0} 13:13:49.366416 --- ParallelTerminationStrategy: PID 9126 died... 13:13:49.385942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9126): Terminated: ok {rc=0} 13:13:49.473843 bus /gobi_0: Setting Powered False 13:13:50.572228 bus /gobi_0: Setting Powered False 13:13:51.687885 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 13:13:52.946076 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:13:52.950240 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:13:52.985623 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 13:13:52.992607 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 13:13:53.047254 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:13:53.082277 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 13:13:53.089399 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 13:13:53.626849 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 13:13:53.631963 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 13:13:53.643289 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:13:53.693217 tst mo_mt_sms.py: using LAC 21699 13:13:53.820408 tst mo_mt_sms.py: using RAC 24 13:13:53.943227 tst mo_mt_sms.py: using CellId 21699 13:13:54.063956 tst mo_mt_sms.py: using BVCI 21700 13:13:54.174084 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:13:54.292360 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:13:54.408835 tst mo_mt_sms.py:9: start nitb and bts... 13:13:54.612758 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:13:55.230751 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9131): Launched 13:13:55.532318 run osmo-nitb_10.42.42.2(pid=9132): Launched 13:13:55.699597 run osmo-nitb_10.42.42.2(pid=9132): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9132)] 13:13:55.835376 run osmo-nitb_10.42.42.2(pid=9132): stdout: | (launched: 2022-12-09_13:13:55.476734) 13:13:55.972252 run osmo-nitb_10.42.42.2(pid=9132): stderr: | (launched: 2022-12-09_13:13:55.521730) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:13:56.109336 run osmo-nitb_10.42.42.2(pid=9132): stdout: | (launched: 2022-12-09_13:13:55.476734) 13:13:56.241233 run osmo-nitb_10.42.42.2(pid=9132): stderr: | (launched: 2022-12-09_13:13:55.521730) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9132): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9132) [trial-2360↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9132)] 13:13:56.646525 tst osmo-nitb_10.42.42.2(pid=9132): stdout: | (launched: 2022-12-09_13:13:55.476734) 13:13:56.768664 tst osmo-nitb_10.42.42.2(pid=9132): stderr: | (launched: 2022-12-09_13:13:55.521730) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:13:56.913067 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9132): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9132) [trial-2360↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9132)] [trial-2360↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 13:13:56.921569 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 13:13:56.928242 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9131): Terminating (SIGTERM) 13:13:57.138049 --- ParallelTerminationStrategy: PID 9131 died... 13:13:57.159480 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9131): Terminated: ok {rc=0} 13:13:57.246396 bus /sierra_3: Setting Powered False 13:13:58.347014 bus /sierra_3: Setting Powered False 13:13:59.463506 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 sms:trx-sysmocell5000 --------------------------------------------------------------------- 13:14:00.664293 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:14:00.668280 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:14:00.702682 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 13:14:00.729730 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 13:14:00.782434 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:14:00.817088 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 13:14:00.844876 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 13:14:01.404021 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 13:14:01.409832 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:14:01.422303 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:14:01.471510 tst mo_mt_sms.py: using LAC 21700 13:14:01.602797 tst mo_mt_sms.py: using RAC 25 13:14:01.729839 tst mo_mt_sms.py: using CellId 21700 13:14:01.857908 tst mo_mt_sms.py: using BVCI 21701 13:14:01.977146 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:14:01.988657 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:14:02.000057 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:14:02.011504 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:14:02.023754 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:14:02.035103 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:14:02.157902 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:14:02.286738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:02.756425 run create_hlr_db(pid=9136): Launched 13:14:02.880866 bus /sierra_2: Setting Powered False 13:14:03.941762 run create_hlr_db(pid=9136): Terminated: ok {rc=0} 13:14:04.363950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9138): Launched 13:14:04.666046 run osmo-hlr_10.42.42.2(pid=9139): Launched 13:14:04.779780 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:05.318184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9141): Launched 13:14:05.622194 run osmo-stp_10.42.42.5(pid=9142): Launched 13:14:05.736905 run osmo-msc_10.42.42.6: Starting osmo-msc 13:14:06.282479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9144): Launched 13:14:06.584046 run osmo-msc_10.42.42.6(pid=9145): Launched 13:14:06.753652 run osmo-stp_10.42.42.5(pid=9142): ERR: Terminated: ERROR {rc=1} [trial-2360↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9142)] 13:14:06.881551 run osmo-stp_10.42.42.5(pid=9142): stdout: | (launched: 2022-12-09_13:14:05.565620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:07.008919 run osmo-stp_10.42.42.5(pid=9142): stderr: | 20221209131405736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131405736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131405736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131405737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131405737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131405737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131405737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:07.135267 run osmo-stp_10.42.42.5(pid=9142): stdout: | (launched: 2022-12-09_13:14:05.565620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:07.255756 run osmo-stp_10.42.42.5(pid=9142): stderr: | 20221209131405736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131405736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131405736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131405737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131405737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131405737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131405737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:07.399130 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9142): Process ended prematurely: osmo-stp_10.42.42.5(pid=9142) [trial-2360↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9142)] [trial-2360↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 13:14:07.407531 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 13:14:07.433816 run osmo-hlr_10.42.42.2(pid=9139): ERR: Terminated: ERROR {rc=237} [trial-2360↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9139)] 13:14:07.481913 run osmo-hlr_10.42.42.2(pid=9139): stdout: | (launched: 2022-12-09_13:14:04.610030) 13:14:07.531861 run osmo-hlr_10.42.42.2(pid=9139): stderr: | 20221209131404785 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131404785 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131404785 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131404785 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131404785 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131404786 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131404798 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131404807 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131404807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131404807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:07.600762 run osmo-msc_10.42.42.6(pid=9145): ERR: Terminated: ERROR {rc=2} [trial-2360↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9145)] 13:14:07.648546 run osmo-msc_10.42.42.6(pid=9145): stdout: | (launched: 2022-12-09_13:14:06.528184) 13:14:07.697989 run osmo-msc_10.42.42.6(pid=9145): stderr: | 20221209131406800 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131406800 DLGLOBAL DEBUG validating counter group 0x7f572f996c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131406801 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131406801 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131406801 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131406801 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131406803 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131406803 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131406803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131406803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:14:07.748031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9138): Terminating (SIGTERM) 13:14:07.787946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9141): Terminating (SIGTERM) 13:14:07.827925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9144): Terminating (SIGTERM) 13:14:07.868092 --- ParallelTerminationStrategy: PID 9138 died... 13:14:07.887444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9138): Terminated: ok {rc=0} 13:14:07.931829 --- ParallelTerminationStrategy: PID 9141 died... 13:14:07.950737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9141): Terminated: ok {rc=0} 13:14:07.995393 --- ParallelTerminationStrategy: PID 9144 died... 13:14:08.014324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9144): Terminated: ok {rc=0} 13:14:08.098357 bus /sierra_3: Setting Powered False 13:14:09.194906 bus /sierra_3: Setting Powered False 13:14:10.311387 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 13:14:11.544808 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:14:11.548629 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:14:11.583043 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 13:14:11.589987 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 13:14:11.626428 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:14:11.660460 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 13:14:11.667390 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 13:14:12.189535 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2360 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 13:14:12.194890 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 13:14:12.206587 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:14:12.259190 tst assert_extension.py: using LAC 21701 13:14:12.386271 tst assert_extension.py: using RAC 26 13:14:12.513032 tst assert_extension.py: using CellId 21701 13:14:12.637107 tst assert_extension.py: using BVCI 21702 13:14:12.747287 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 13:14:12.865291 tst assert_extension.py:10: start nitb and bts... 13:14:13.067504 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:14:13.687944 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9150): Launched 13:14:13.990311 run osmo-nitb_10.42.42.2(pid=9151): Launched 13:14:14.158526 run osmo-nitb_10.42.42.2(pid=9151): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9151)] 13:14:14.293493 run osmo-nitb_10.42.42.2(pid=9151): stdout: | (launched: 2022-12-09_13:14:13.934105) 13:14:14.430204 run osmo-nitb_10.42.42.2(pid=9151): stderr: | (launched: 2022-12-09_13:14:13.979104) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:14:14.566734 run osmo-nitb_10.42.42.2(pid=9151): stdout: | (launched: 2022-12-09_13:14:13.934105) 13:14:14.698135 run osmo-nitb_10.42.42.2(pid=9151): stderr: | (launched: 2022-12-09_13:14:13.979104) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9151): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9151) [trial-2360↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9151)] 13:14:15.105228 tst osmo-nitb_10.42.42.2(pid=9151): stdout: | (launched: 2022-12-09_13:14:13.934105) 13:14:15.226607 tst osmo-nitb_10.42.42.2(pid=9151): stderr: | (launched: 2022-12-09_13:14:13.979104) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:14:15.371041 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9151): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9151) [trial-2360↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9151)] [trial-2360↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 13:14:15.379510 tst assert_extension.py:12: Test FAILED (3.2 sec) 13:14:15.386290 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9150): Terminating (SIGTERM) 13:14:15.595083 --- ParallelTerminationStrategy: PID 9150 died... 13:14:15.616256 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9150): Terminated: ok {rc=0} 13:14:15.702824 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 13:14:16.886416 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:14:16.890724 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:14:16.934081 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 13:14:16.963747 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 13:14:17.001078 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:14:17.048533 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 13:14:17.083498 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 13:14:17.595426 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2360 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 13:14:17.601027 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:14:17.612485 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:14:17.662044 tst assert_extension.py: using LAC 21702 13:14:17.789108 tst assert_extension.py: using RAC 27 13:14:17.915352 tst assert_extension.py: using CellId 21702 13:14:18.041391 tst assert_extension.py: using BVCI 21703 13:14:18.158496 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:14:18.169897 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:14:18.180911 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:14:18.192241 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:14:18.203518 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:14:18.214796 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 13:14:18.332522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:18.833344 run create_hlr_db(pid=9155): Launched 13:14:18.956492 bus /sierra_2: Setting Powered False 13:14:20.020569 run create_hlr_db(pid=9155): Terminated: ok {rc=0} 13:14:20.453575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9157): Launched 13:14:20.755781 run osmo-hlr_10.42.42.2(pid=9158): Launched 13:14:20.871075 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:21.493831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9160): Launched 13:14:21.790591 run osmo-stp_10.42.42.5(pid=9161): Launched 13:14:21.903902 run osmo-msc_10.42.42.6: Starting osmo-msc 13:14:22.442428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9163): Launched 13:14:22.739380 run osmo-msc_10.42.42.6(pid=9164): Launched 13:14:22.904811 run osmo-stp_10.42.42.5(pid=9161): ERR: Terminated: ERROR {rc=1} [trial-2360↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9161)] 13:14:23.030508 run osmo-stp_10.42.42.5(pid=9161): stdout: | (launched: 2022-12-09_13:14:21.735889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:23.156425 run osmo-stp_10.42.42.5(pid=9161): stderr: | 20221209131421904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131421904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131421904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131421905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131421905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131421905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131421905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:23.280465 run osmo-stp_10.42.42.5(pid=9161): stdout: | (launched: 2022-12-09_13:14:21.735889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:23.399377 run osmo-stp_10.42.42.5(pid=9161): stderr: | 20221209131421904 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131421904 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131421904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131421905 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131421905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131421905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131421905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:23.540839 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9161): Process ended prematurely: osmo-stp_10.42.42.5(pid=9161) [trial-2360↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9161)] [trial-2360↪ussd:trx-sysmocell5000↪assert_extension.py:17] 13:14:23.549042 tst assert_extension.py:17: Test FAILED (5.9 sec) 13:14:23.575086 run osmo-hlr_10.42.42.2(pid=9158): ERR: Terminated: ERROR {rc=237} [trial-2360↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9158)] 13:14:23.622649 run osmo-hlr_10.42.42.2(pid=9158): stdout: | (launched: 2022-12-09_13:14:20.699809) 13:14:23.671851 run osmo-hlr_10.42.42.2(pid=9158): stderr: | 20221209131420877 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131420877 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131420877 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131420877 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131420877 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131420877 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131420889 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131420898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131420898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131420898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:23.740421 run osmo-msc_10.42.42.6(pid=9164): ERR: Terminated: ERROR {rc=2} [trial-2360↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9164)] 13:14:23.787887 run osmo-msc_10.42.42.6(pid=9164): stdout: | (launched: 2022-12-09_13:14:22.683884) 13:14:23.837226 run osmo-msc_10.42.42.6(pid=9164): stderr: | 20221209131422955 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131422955 DLGLOBAL DEBUG validating counter group 0x7fb43bf2cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131422955 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131422955 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131422955 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131422955 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131422958 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131422959 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131422959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131422959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:14:23.886758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9157): Terminating (SIGTERM) 13:14:23.926517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9160): Terminating (SIGTERM) 13:14:23.966063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9163): Terminating (SIGTERM) 13:14:24.005913 --- ParallelTerminationStrategy: PID 9157 died... 13:14:24.024781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9157): Terminated: ok {rc=0} 13:14:24.068409 --- ParallelTerminationStrategy: PID 9160 died... 13:14:24.087019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9160): Terminated: ok {rc=0} 13:14:24.130572 --- ParallelTerminationStrategy: PID 9163 died... 13:14:24.149148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9163): Terminated: ok {rc=0} 13:14:24.232168 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:14:25.448533 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:14:25.455840 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:14:25.491492 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:14:25.519207 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:14:25.571697 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:14:25.606879 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:14:25.634391 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:14:26.188315 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:14:26.241661 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:14:26.253580 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:14:26.326227 tst mo_mt_call.py: using LAC 21703 13:14:26.447868 tst mo_mt_call.py: using RAC 28 13:14:26.569160 tst mo_mt_call.py: using CellId 21703 13:14:26.689250 tst mo_mt_call.py: using BVCI 21704 13:14:26.800357 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:14:26.811774 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:14:26.822991 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:14:26.834174 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:14:26.845317 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:14:26.856226 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:14:26.975569 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:14:27.090919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:27.563508 run create_hlr_db(pid=9169): Launched 13:14:27.687311 bus /sierra_2: Setting Powered False 13:14:28.750769 run create_hlr_db(pid=9169): Terminated: ok {rc=0} 13:14:29.201601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9171): Launched 13:14:29.526025 run osmo-hlr_10.42.42.2(pid=9172): Launched 13:14:29.652220 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:30.209365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9174): Launched 13:14:30.532789 run osmo-stp_10.42.42.5(pid=9175): Launched 13:14:30.657291 run osmo-msc_10.42.42.6: Starting osmo-msc 13:14:31.258942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9177): Launched 13:14:31.601807 run osmo-msc_10.42.42.6(pid=9178): Launched 13:14:32.128456 run osmo-stp_10.42.42.5(pid=9175): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9175)] 13:14:32.273253 run osmo-stp_10.42.42.5(pid=9175): stdout: | (launched: 2022-12-09_13:14:30.473529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:32.463111 run osmo-stp_10.42.42.5(pid=9175): stderr: | 20221209131430665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131430666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131430666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131430666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131430667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131430667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131430667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:32.600193 run osmo-stp_10.42.42.5(pid=9175): stdout: | (launched: 2022-12-09_13:14:30.473529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:32.729612 run osmo-stp_10.42.42.5(pid=9175): stderr: | 20221209131430665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131430666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131430666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131430666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131430667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131430667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131430667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:32.884781 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9175): Process ended prematurely: osmo-stp_10.42.42.5(pid=9175) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9175)] [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:14:32.894375 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 13:14:32.922657 run osmo-hlr_10.42.42.2(pid=9172): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9172)] 13:14:32.973543 run osmo-hlr_10.42.42.2(pid=9172): stdout: | (launched: 2022-12-09_13:14:29.467145) 13:14:33.025829 run osmo-hlr_10.42.42.2(pid=9172): stderr: | 20221209131429664 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131429664 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131429664 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131429664 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131429664 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131429664 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131429692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131429702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131429702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131429702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:33.098800 run osmo-msc_10.42.42.6(pid=9178): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9178)] 13:14:33.149374 run osmo-msc_10.42.42.6(pid=9178): stdout: | (launched: 2022-12-09_13:14:31.534537) 13:14:33.201787 run osmo-msc_10.42.42.6(pid=9178): stderr: | 20221209131432059 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131432059 DLGLOBAL DEBUG validating counter group 0x7f3b909aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131432059 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131432059 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131432060 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131432060 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131432070 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131432070 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131432070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131432070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:14:33.254476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9171): Terminating (SIGTERM) 13:14:33.296595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9174): Terminating (SIGTERM) 13:14:33.338856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9177): Terminating (SIGTERM) 13:14:33.381343 --- ParallelTerminationStrategy: PID 9171 died... 13:14:33.400875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9171): Terminated: ok {rc=0} 13:14:33.447636 --- ParallelTerminationStrategy: PID 9174 died... 13:14:33.467222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9174): Terminated: ok {rc=0} 13:14:33.513454 --- ParallelTerminationStrategy: PID 9177 died... 13:14:33.532768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9177): Terminated: ok {rc=0} 13:14:33.620773 bus /sierra_3: Setting Powered False 13:14:34.720388 bus /sierra_3: Setting Powered False 13:14:35.836519 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:14:36.982972 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:14:36.995214 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:14:37.066721 tst mo_mt_call_osmux.py: using LAC 21704 13:14:37.188541 tst mo_mt_call_osmux.py: using RAC 29 13:14:37.308691 tst mo_mt_call_osmux.py: using CellId 21704 13:14:37.429658 tst mo_mt_call_osmux.py: using BVCI 21705 13:14:37.540938 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:14:37.552436 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:14:37.563737 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:14:37.575000 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:14:37.586413 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:14:37.597733 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:14:37.716338 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:14:37.837635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:38.340803 run create_hlr_db(pid=9180): Launched 13:14:38.465161 bus /sierra_2: Setting Powered False 13:14:39.529341 run create_hlr_db(pid=9180): Terminated: ok {rc=0} 13:14:39.961859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9182): Launched 13:14:40.266964 run osmo-hlr_10.42.42.2(pid=9183): Launched 13:14:40.385385 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:40.924083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9185): Launched 13:14:41.228648 run osmo-stp_10.42.42.5(pid=9186): Launched 13:14:41.344458 run osmo-msc_10.42.42.6: Starting osmo-msc 13:14:41.895298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9188): Launched 13:14:42.199312 run osmo-msc_10.42.42.6(pid=9189): Launched 13:14:42.369178 run osmo-stp_10.42.42.5(pid=9186): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9186)] 13:14:42.497724 run osmo-stp_10.42.42.5(pid=9186): stdout: | (launched: 2022-12-09_13:14:41.172486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:42.626119 run osmo-stp_10.42.42.5(pid=9186): stderr: | 20221209131441345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131441345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131441345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131441346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131441346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131441346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131441346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:42.752788 run osmo-stp_10.42.42.5(pid=9186): stdout: | (launched: 2022-12-09_13:14:41.172486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:42.874102 run osmo-stp_10.42.42.5(pid=9186): stderr: | 20221209131441345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131441345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131441345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131441346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131441346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131441346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131441346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:43.019203 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9186): Process ended prematurely: osmo-stp_10.42.42.5(pid=9186) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9186)] [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:14:43.028120 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:14:43.054207 run osmo-hlr_10.42.42.2(pid=9183): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9183)] 13:14:43.101367 run osmo-hlr_10.42.42.2(pid=9183): stdout: | (launched: 2022-12-09_13:14:40.211139) 13:14:43.150584 run osmo-hlr_10.42.42.2(pid=9183): stderr: | 20221209131440385 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131440385 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131440385 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131440385 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131440385 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131440385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131440397 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131440405 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131440405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131440405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:43.218900 run osmo-msc_10.42.42.6(pid=9189): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9189)] 13:14:43.265918 run osmo-msc_10.42.42.6(pid=9189): stdout: | (launched: 2022-12-09_13:14:42.143445) 13:14:43.314500 run osmo-msc_10.42.42.6(pid=9189): stderr: | 20221209131442417 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131442417 DLGLOBAL DEBUG validating counter group 0x7f605695bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131442417 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131442417 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131442418 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131442418 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131442421 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131442421 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131442421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131442421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:14:43.363538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9182): Terminating (SIGTERM) 13:14:43.402947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9185): Terminating (SIGTERM) 13:14:43.442319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9188): Terminating (SIGTERM) 13:14:43.481964 --- ParallelTerminationStrategy: PID 9182 died... 13:14:43.501354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9182): Terminated: ok {rc=0} 13:14:43.545107 --- ParallelTerminationStrategy: PID 9185 died... 13:14:43.563551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9185): Terminated: ok {rc=0} 13:14:43.606919 --- ParallelTerminationStrategy: PID 9188 died... 13:14:43.625448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9188): Terminated: ok {rc=0} 13:14:43.708026 bus /sierra_3: Setting Powered False 13:14:44.805556 bus /sierra_3: Setting Powered False 13:14:45.935616 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:14:47.200278 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:14:47.208814 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:14:47.248647 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:14:47.280816 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:14:47.332278 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:14:47.366165 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:14:47.392601 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:14:47.944424 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:14:47.992652 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:14:48.003964 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:14:48.073770 tst mo_mt_call.py: using LAC 21705 13:14:48.192941 tst mo_mt_call.py: using RAC 30 13:14:48.312291 tst mo_mt_call.py: using CellId 21705 13:14:48.432483 tst mo_mt_call.py: using BVCI 21706 13:14:48.542826 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:14:48.554201 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:14:48.565317 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:14:48.576351 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:14:48.587538 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:14:48.598546 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:14:48.714839 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:14:48.831229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:49.335622 run create_hlr_db(pid=9194): Launched 13:14:49.461859 bus /sierra_2: Setting Powered False 13:14:50.525797 run create_hlr_db(pid=9194): Terminated: ok {rc=0} 13:14:50.977489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9196): Launched 13:14:51.302454 run osmo-hlr_10.42.42.2(pid=9197): Launched 13:14:51.426737 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:51.991084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9199): Launched 13:14:52.316159 run osmo-stp_10.42.42.5(pid=9200): Launched 13:14:52.440812 run osmo-msc_10.42.42.6: Starting osmo-msc 13:14:53.032542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9202): Launched 13:14:53.357138 run osmo-msc_10.42.42.6(pid=9203): Launched 13:14:53.537853 run osmo-stp_10.42.42.5(pid=9200): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9200)] 13:14:53.675006 run osmo-stp_10.42.42.5(pid=9200): stdout: | (launched: 2022-12-09_13:14:52.256424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:53.812673 run osmo-stp_10.42.42.5(pid=9200): stderr: | 20221209131452448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131452448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131452448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131452449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131452449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131452449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131452449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:53.949969 run osmo-stp_10.42.42.5(pid=9200): stdout: | (launched: 2022-12-09_13:14:52.256424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:54.079470 run osmo-stp_10.42.42.5(pid=9200): stderr: | 20221209131452448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131452448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131452448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131452449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131452449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131452449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131452449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:54.234562 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9200): Process ended prematurely: osmo-stp_10.42.42.5(pid=9200) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9200)] [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:14:54.244079 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:14:54.272113 run osmo-hlr_10.42.42.2(pid=9197): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9197)] 13:14:54.323072 run osmo-hlr_10.42.42.2(pid=9197): stdout: | (launched: 2022-12-09_13:14:51.242894) 13:14:54.375349 run osmo-hlr_10.42.42.2(pid=9197): stderr: | 20221209131451442 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131451442 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131451442 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131451442 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131451442 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131451442 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131451454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131451462 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131451463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131451463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:54.448309 run osmo-msc_10.42.42.6(pid=9203): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9203)] 13:14:54.498707 run osmo-msc_10.42.42.6(pid=9203): stdout: | (launched: 2022-12-09_13:14:53.297307) 13:14:54.551162 run osmo-msc_10.42.42.6(pid=9203): stderr: | 20221209131453619 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131453619 DLGLOBAL DEBUG validating counter group 0x7fbd84fafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131453620 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131453620 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131453620 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131453620 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131453622 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131453622 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131453622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131453622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:14:54.603764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9196): Terminating (SIGTERM) 13:14:54.645935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9199): Terminating (SIGTERM) 13:14:54.688057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9202): Terminating (SIGTERM) 13:14:54.730471 --- ParallelTerminationStrategy: PID 9196 died... 13:14:54.750357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9196): Terminated: ok {rc=0} 13:14:54.796798 --- ParallelTerminationStrategy: PID 9199 died... 13:14:54.816216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9199): Terminated: ok {rc=0} 13:14:54.862641 --- ParallelTerminationStrategy: PID 9202 died... 13:14:54.882086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9202): Terminated: ok {rc=0} 13:14:54.969519 bus /sierra_3: Setting Powered False 13:14:56.066351 bus /sierra_3: Setting Powered False 13:14:57.181879 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:14:58.331623 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:14:58.344218 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:14:58.416620 tst mo_mt_call_osmux.py: using LAC 21706 13:14:58.545070 tst mo_mt_call_osmux.py: using RAC 31 13:14:58.672108 tst mo_mt_call_osmux.py: using CellId 21706 13:14:58.801996 tst mo_mt_call_osmux.py: using BVCI 21707 13:14:58.922113 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:14:58.933991 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:14:58.945519 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:14:58.957238 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:14:58.969128 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:14:58.980822 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:14:59.100006 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:14:59.217833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:59.692739 run create_hlr_db(pid=9205): Launched 13:14:59.817129 bus /sierra_2: Setting Powered False 13:15:00.890199 run create_hlr_db(pid=9205): Terminated: ok {rc=0} 13:15:01.369973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9210): Launched 13:15:01.734195 run osmo-hlr_10.42.42.2(pid=9211): Launched 13:15:02.033374 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:02.615846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9213): Launched 13:15:02.920752 run osmo-stp_10.42.42.5(pid=9214): Launched 13:15:03.036637 run osmo-msc_10.42.42.6: Starting osmo-msc 13:15:03.588361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9216): Launched 13:15:03.894449 run osmo-msc_10.42.42.6(pid=9217): Launched 13:15:04.067315 run osmo-stp_10.42.42.5(pid=9214): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9214)] 13:15:04.205480 run osmo-stp_10.42.42.5(pid=9214): stdout: | (launched: 2022-12-09_13:15:02.864697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:04.345992 run osmo-stp_10.42.42.5(pid=9214): stderr: | 20221209131503035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131503035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131503035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131503036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131503036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131503036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131503036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:04.481222 run osmo-stp_10.42.42.5(pid=9214): stdout: | (launched: 2022-12-09_13:15:02.864697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:04.611198 run osmo-stp_10.42.42.5(pid=9214): stderr: | 20221209131503035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131503035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131503035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131503036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131503036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131503036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131503036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:04.766044 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9214): Process ended prematurely: osmo-stp_10.42.42.5(pid=9214) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9214)] [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:15:04.775802 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 13:15:04.804228 run osmo-hlr_10.42.42.2(pid=9211): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9211)] 13:15:04.855480 run osmo-hlr_10.42.42.2(pid=9211): stdout: | (launched: 2022-12-09_13:15:01.674896) 13:15:04.907830 run osmo-hlr_10.42.42.2(pid=9211): stderr: | 20221209131501901 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131501901 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131501901 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131501902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131501902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131501902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131501919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131501935 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131501935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131501935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:04.980587 run osmo-msc_10.42.42.6(pid=9217): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9217)] 13:15:05.031081 run osmo-msc_10.42.42.6(pid=9217): stdout: | (launched: 2022-12-09_13:15:03.838176) 13:15:05.083182 run osmo-msc_10.42.42.6(pid=9217): stderr: | 20221209131504109 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131504110 DLGLOBAL DEBUG validating counter group 0x7f3d7d156c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131504110 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131504110 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131504110 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131504110 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131504112 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131504112 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131504112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131504112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:15:05.135575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9210): Terminating (SIGTERM) 13:15:05.177810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9213): Terminating (SIGTERM) 13:15:05.220105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9216): Terminating (SIGTERM) 13:15:05.262525 --- ParallelTerminationStrategy: PID 9210 died... 13:15:05.282478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9210): Terminated: ok {rc=0} 13:15:05.329467 --- ParallelTerminationStrategy: PID 9213 died... 13:15:05.348898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9213): Terminated: ok {rc=0} 13:15:05.395577 --- ParallelTerminationStrategy: PID 9216 died... 13:15:05.415267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9216): Terminated: ok {rc=0} 13:15:05.503282 bus /sierra_3: Setting Powered False 13:15:06.601680 bus /sierra_3: Setting Powered False 13:15:07.716588 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:15:08.970360 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:15:08.976597 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:15:09.010038 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:15:09.036446 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:15:09.091987 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:15:09.125468 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:15:09.151764 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:15:09.700610 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:15:09.750136 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:15:09.761467 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:15:09.829390 tst mo_mt_call.py: using LAC 21707 13:15:09.950154 tst mo_mt_call.py: using RAC 32 13:15:10.069322 tst mo_mt_call.py: using CellId 21707 13:15:10.187884 tst mo_mt_call.py: using BVCI 21708 13:15:10.300145 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:15:10.311483 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:15:10.322697 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:15:10.333763 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:15:10.344765 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:15:10.355867 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:15:10.473823 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:15:10.589123 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:11.063582 run create_hlr_db(pid=9224): Launched 13:15:11.189374 bus /sierra_2: Setting Powered False 13:15:12.250360 run create_hlr_db(pid=9224): Terminated: ok {rc=0} 13:15:12.694768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9227): Launched 13:15:13.022215 run osmo-hlr_10.42.42.2(pid=9228): Launched 13:15:13.146139 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:13.709246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9230): Launched 13:15:14.034947 run osmo-stp_10.42.42.5(pid=9231): Launched 13:15:14.159887 run osmo-msc_10.42.42.6: Starting osmo-msc 13:15:14.748623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9233): Launched 13:15:15.074755 run osmo-msc_10.42.42.6(pid=9234): Launched 13:15:15.258425 run osmo-stp_10.42.42.5(pid=9231): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9231)] 13:15:15.396202 run osmo-stp_10.42.42.5(pid=9231): stdout: | (launched: 2022-12-09_13:15:13.975631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:15.534235 run osmo-stp_10.42.42.5(pid=9231): stderr: | 20221209131514168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131514168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131514168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131514168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131514169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131514169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131514169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:15.671437 run osmo-stp_10.42.42.5(pid=9231): stdout: | (launched: 2022-12-09_13:15:13.975631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:15.801759 run osmo-stp_10.42.42.5(pid=9231): stderr: | 20221209131514168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131514168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131514168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131514168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131514169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131514169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131514169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:15.982959 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9231): Process ended prematurely: osmo-stp_10.42.42.5(pid=9231) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9231)] [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:15:15.992410 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:15:16.021356 run osmo-hlr_10.42.42.2(pid=9228): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9228)] 13:15:16.070621 run osmo-hlr_10.42.42.2(pid=9228): stdout: | (launched: 2022-12-09_13:15:12.962449) 13:15:16.122397 run osmo-hlr_10.42.42.2(pid=9228): stderr: | 20221209131513161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131513161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131513161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131513161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131513161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131513161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131513174 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131513183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131513183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131513183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:16.194959 run osmo-msc_10.42.42.6(pid=9234): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9234)] 13:15:16.246130 run osmo-msc_10.42.42.6(pid=9234): stdout: | (launched: 2022-12-09_13:15:15.015269) 13:15:16.297779 run osmo-msc_10.42.42.6(pid=9234): stderr: | 20221209131515337 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131515337 DLGLOBAL DEBUG validating counter group 0x7f493e969c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131515337 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131515338 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131515338 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131515338 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131515340 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131515340 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131515340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131515340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:15:16.349409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9227): Terminating (SIGTERM) 13:15:16.391048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9230): Terminating (SIGTERM) 13:15:16.436589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9233): Terminating (SIGTERM) 13:15:16.480747 --- ParallelTerminationStrategy: PID 9227 died... 13:15:16.501122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9227): Terminated: ok {rc=0} 13:15:16.548774 --- ParallelTerminationStrategy: PID 9230 died... 13:15:16.568652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9230): Terminated: ok {rc=0} 13:15:16.614752 --- ParallelTerminationStrategy: PID 9233 died... 13:15:16.635581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9233): Terminated: ok {rc=0} 13:15:16.725406 bus /sierra_3: Setting Powered False 13:15:17.823017 bus /sierra_3: Setting Powered False 13:15:18.940005 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:15:20.090166 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:15:20.102682 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:15:20.179145 tst mo_mt_call_osmux.py: using LAC 21708 13:15:20.300142 tst mo_mt_call_osmux.py: using RAC 33 13:15:20.419533 tst mo_mt_call_osmux.py: using CellId 21708 13:15:20.538383 tst mo_mt_call_osmux.py: using BVCI 21709 13:15:20.650660 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:15:20.662003 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:15:20.673773 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:15:20.684743 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:15:20.695854 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:15:20.706861 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:15:20.824020 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:15:20.946735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:21.454789 run create_hlr_db(pid=9236): Launched 13:15:21.582061 bus /sierra_2: Setting Powered False 13:15:22.646907 run create_hlr_db(pid=9236): Terminated: ok {rc=0} 13:15:23.083641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9238): Launched 13:15:23.390660 run osmo-hlr_10.42.42.2(pid=9239): Launched 13:15:23.507781 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:24.033922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9241): Launched 13:15:24.341585 run osmo-stp_10.42.42.5(pid=9242): Launched 13:15:24.457815 run osmo-msc_10.42.42.6: Starting osmo-msc 13:15:25.010251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9244): Launched 13:15:25.316295 run osmo-msc_10.42.42.6(pid=9245): Launched 13:15:25.487217 run osmo-stp_10.42.42.5(pid=9242): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9242)] 13:15:25.616748 run osmo-stp_10.42.42.5(pid=9242): stdout: | (launched: 2022-12-09_13:15:24.284749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:25.745938 run osmo-stp_10.42.42.5(pid=9242): stderr: | 20221209131524455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131524455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131524455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131524456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131524456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131524456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131524456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:25.873955 run osmo-stp_10.42.42.5(pid=9242): stdout: | (launched: 2022-12-09_13:15:24.284749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:25.995582 run osmo-stp_10.42.42.5(pid=9242): stderr: | 20221209131524455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131524455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131524455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131524456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131524456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131524456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131524456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:26.140894 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9242): Process ended prematurely: osmo-stp_10.42.42.5(pid=9242) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9242)] [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:15:26.149905 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:15:26.175979 run osmo-hlr_10.42.42.2(pid=9239): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9239)] 13:15:26.223460 run osmo-hlr_10.42.42.2(pid=9239): stdout: | (launched: 2022-12-09_13:15:23.334278) 13:15:26.272654 run osmo-hlr_10.42.42.2(pid=9239): stderr: | 20221209131523510 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131523510 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131523510 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131523510 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131523511 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131523511 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131523526 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131523536 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131523537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131523537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:26.341491 run osmo-msc_10.42.42.6(pid=9245): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9245)] 13:15:26.389167 run osmo-msc_10.42.42.6(pid=9245): stdout: | (launched: 2022-12-09_13:15:25.258992) 13:15:26.438137 run osmo-msc_10.42.42.6(pid=9245): stderr: | 20221209131525531 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131525531 DLGLOBAL DEBUG validating counter group 0x7ff414dc2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131525531 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131525531 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131525531 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131525532 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131525533 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131525534 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131525534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131525534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:15:26.487591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9238): Terminating (SIGTERM) 13:15:26.527028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9241): Terminating (SIGTERM) 13:15:26.566514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9244): Terminating (SIGTERM) 13:15:26.606239 --- ParallelTerminationStrategy: PID 9238 died... 13:15:26.625250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9238): Terminated: ok {rc=0} 13:15:26.668853 --- ParallelTerminationStrategy: PID 9241 died... 13:15:26.687804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9241): Terminated: ok {rc=0} 13:15:26.731373 --- ParallelTerminationStrategy: PID 9244 died... 13:15:26.749954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9244): Terminated: ok {rc=0} 13:15:26.835883 bus /sierra_3: Setting Powered False 13:15:27.936817 bus /sierra_3: Setting Powered False 13:15:29.052390 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:15:30.312102 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:15:30.319582 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:15:30.355647 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:15:30.383286 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:15:30.437885 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:15:30.473197 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:15:30.500677 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:15:31.061407 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:15:31.120232 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:15:31.132406 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:15:31.205669 tst mo_mt_call.py: using LAC 21709 13:15:31.340831 tst mo_mt_call.py: using RAC 34 13:15:31.471792 tst mo_mt_call.py: using CellId 21709 13:15:31.594326 tst mo_mt_call.py: using BVCI 21710 13:15:31.709081 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:15:31.720508 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:15:31.732177 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:15:31.744380 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:15:31.756053 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:15:31.767953 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:15:31.882493 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:15:32.001065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:32.541872 run create_hlr_db(pid=9250): Launched 13:15:32.669464 bus /sierra_2: Setting Powered False 13:15:33.734445 run create_hlr_db(pid=9250): Terminated: ok {rc=0} 13:15:34.170216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9252): Launched 13:15:34.476424 run osmo-hlr_10.42.42.2(pid=9253): Launched 13:15:34.595233 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:35.122412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9255): Launched 13:15:35.428092 run osmo-stp_10.42.42.5(pid=9256): Launched 13:15:35.544441 run osmo-msc_10.42.42.6: Starting osmo-msc 13:15:36.097504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9258): Launched 13:15:36.403386 run osmo-msc_10.42.42.6(pid=9259): Launched 13:15:36.574400 run osmo-stp_10.42.42.5(pid=9256): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9256)] 13:15:36.705516 run osmo-stp_10.42.42.5(pid=9256): stdout: | (launched: 2022-12-09_13:15:35.371405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:36.834609 run osmo-stp_10.42.42.5(pid=9256): stderr: | 20221209131535542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131535542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131535542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131535542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131535543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131535543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131535543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:36.962126 run osmo-stp_10.42.42.5(pid=9256): stdout: | (launched: 2022-12-09_13:15:35.371405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:37.084182 run osmo-stp_10.42.42.5(pid=9256): stderr: | 20221209131535542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131535542 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131535542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131535542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131535543 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131535543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131535543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:37.230098 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9256): Process ended prematurely: osmo-stp_10.42.42.5(pid=9256) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9256)] [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:15:37.239033 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:15:37.266103 run osmo-hlr_10.42.42.2(pid=9253): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9253)] 13:15:37.314771 run osmo-hlr_10.42.42.2(pid=9253): stdout: | (launched: 2022-12-09_13:15:34.420265) 13:15:37.365052 run osmo-hlr_10.42.42.2(pid=9253): stderr: | 20221209131534598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131534598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131534598 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131534598 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131534598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131534598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131534613 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131534625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131534625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131534625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:37.435036 run osmo-msc_10.42.42.6(pid=9259): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9259)] 13:15:37.483716 run osmo-msc_10.42.42.6(pid=9259): stdout: | (launched: 2022-12-09_13:15:36.347045) 13:15:37.534035 run osmo-msc_10.42.42.6(pid=9259): stderr: | 20221209131536622 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131536622 DLGLOBAL DEBUG validating counter group 0x7f79c30a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131536622 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131536622 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131536622 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131536622 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131536624 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131536624 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131536625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131536625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:15:37.584459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9252): Terminating (SIGTERM) 13:15:37.624698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9255): Terminating (SIGTERM) 13:15:37.665124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9258): Terminating (SIGTERM) 13:15:37.706220 --- ParallelTerminationStrategy: PID 9252 died... 13:15:37.725469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9252): Terminated: ok {rc=0} 13:15:37.770972 --- ParallelTerminationStrategy: PID 9255 died... 13:15:37.789718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9255): Terminated: ok {rc=0} 13:15:37.834867 --- ParallelTerminationStrategy: PID 9258 died... 13:15:37.853736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9258): Terminated: ok {rc=0} 13:15:37.940562 bus /sierra_3: Setting Powered False 13:15:39.043143 bus /sierra_3: Setting Powered False 13:15:40.161500 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:15:41.313362 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:15:41.325944 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:15:41.398868 tst mo_mt_call_osmux.py: using LAC 21710 13:15:41.527982 tst mo_mt_call_osmux.py: using RAC 35 13:15:41.649717 tst mo_mt_call_osmux.py: using CellId 21710 13:15:41.777944 tst mo_mt_call_osmux.py: using BVCI 21711 13:15:41.897427 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:15:41.909474 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:15:41.921202 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:15:41.933063 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:15:41.945090 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:15:41.956917 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:15:42.072077 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:15:42.188104 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:42.661928 run create_hlr_db(pid=9261): Launched 13:15:42.788614 bus /sierra_2: Setting Powered False 13:15:43.849587 run create_hlr_db(pid=9261): Terminated: ok {rc=0} 13:15:44.293687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9263): Launched 13:15:44.619356 run osmo-hlr_10.42.42.2(pid=9264): Launched 13:15:44.743444 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:45.306580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9266): Launched 13:15:45.633174 run osmo-stp_10.42.42.5(pid=9267): Launched 13:15:45.759117 run osmo-msc_10.42.42.6: Starting osmo-msc 13:15:46.425611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9269): Launched 13:15:46.750129 run osmo-msc_10.42.42.6(pid=9270): Launched 13:15:47.179417 run osmo-stp_10.42.42.5(pid=9267): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9267)] 13:15:47.415272 run osmo-stp_10.42.42.5(pid=9267): stdout: | (launched: 2022-12-09_13:15:45.573480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:47.543261 run osmo-stp_10.42.42.5(pid=9267): stderr: | 20221209131545766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131545766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131545766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131545767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131545767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131545767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131545767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:47.670593 run osmo-stp_10.42.42.5(pid=9267): stdout: | (launched: 2022-12-09_13:15:45.573480) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:47.791932 run osmo-stp_10.42.42.5(pid=9267): stderr: | 20221209131545766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131545766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131545766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131545767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131545767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131545767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131545767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:47.937569 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9267): Process ended prematurely: osmo-stp_10.42.42.5(pid=9267) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9267)] [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:15:47.946531 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 13:15:47.972937 run osmo-hlr_10.42.42.2(pid=9264): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9264)] 13:15:48.021109 run osmo-hlr_10.42.42.2(pid=9264): stdout: | (launched: 2022-12-09_13:15:44.558879) 13:15:48.070560 run osmo-hlr_10.42.42.2(pid=9264): stderr: | 20221209131544757 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131544757 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131544757 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131544757 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131544757 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131544757 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131544770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131544778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131544778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131544778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:48.139516 run osmo-msc_10.42.42.6(pid=9270): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9270)] 13:15:48.186902 run osmo-msc_10.42.42.6(pid=9270): stdout: | (launched: 2022-12-09_13:15:46.692332) 13:15:48.235815 run osmo-msc_10.42.42.6(pid=9270): stderr: | 20221209131547215 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131547215 DLGLOBAL DEBUG validating counter group 0x7f63e3273c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131547215 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131547215 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131547215 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131547216 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131547218 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131547219 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131547219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131547219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:15:48.285349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9263): Terminating (SIGTERM) 13:15:48.325030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9266): Terminating (SIGTERM) 13:15:48.364804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9269): Terminating (SIGTERM) 13:15:48.405032 --- ParallelTerminationStrategy: PID 9263 died... 13:15:48.424095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9263): Terminated: ok {rc=0} 13:15:48.468111 --- ParallelTerminationStrategy: PID 9266 died... 13:15:48.486791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9266): Terminated: ok {rc=0} 13:15:48.530496 --- ParallelTerminationStrategy: PID 9269 died... 13:15:48.549323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9269): Terminated: ok {rc=0} 13:15:48.632879 bus /sierra_3: Setting Powered False 13:15:49.726523 bus /sierra_3: Setting Powered False 13:15:50.841002 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:15:52.099249 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:15:52.106917 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:15:52.140517 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:15:52.167159 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:15:52.217512 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:15:52.250841 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:15:52.277070 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:15:52.835016 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:15:52.883466 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:15:52.894777 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:15:52.963612 tst mo_mt_call.py: using LAC 21711 13:15:53.081969 tst mo_mt_call.py: using RAC 36 13:15:53.203168 tst mo_mt_call.py: using CellId 21711 13:15:53.323488 tst mo_mt_call.py: using BVCI 21712 13:15:53.433963 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:15:53.445351 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:15:53.456394 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:15:53.467491 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:15:53.478637 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:15:53.489666 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:15:53.609903 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:15:53.731262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:54.238032 run create_hlr_db(pid=9275): Launched 13:15:54.364559 bus /sierra_2: Setting Powered False 13:15:55.428889 run create_hlr_db(pid=9275): Terminated: ok {rc=0} 13:15:55.865987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9277): Launched 13:15:56.171909 run osmo-hlr_10.42.42.2(pid=9278): Launched 13:15:56.288165 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:56.832731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9280): Launched 13:15:57.138615 run osmo-stp_10.42.42.5(pid=9281): Launched 13:15:57.256198 run osmo-msc_10.42.42.6: Starting osmo-msc 13:15:57.809973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9283): Launched 13:15:58.115882 run osmo-msc_10.42.42.6(pid=9284): Launched 13:15:58.286600 run osmo-stp_10.42.42.5(pid=9281): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9281)] 13:15:58.415724 run osmo-stp_10.42.42.5(pid=9281): stdout: | (launched: 2022-12-09_13:15:57.081562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:58.544917 run osmo-stp_10.42.42.5(pid=9281): stderr: | 20221209131557252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131557252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131557253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131557253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131557254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131557254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131557254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:58.671977 run osmo-stp_10.42.42.5(pid=9281): stdout: | (launched: 2022-12-09_13:15:57.081562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:58.793265 run osmo-stp_10.42.42.5(pid=9281): stderr: | 20221209131557252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131557252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131557253 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131557253 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131557254 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131557254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131557254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:58.938750 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9281): Process ended prematurely: osmo-stp_10.42.42.5(pid=9281) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9281)] [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:15:58.947559 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:15:58.974045 run osmo-hlr_10.42.42.2(pid=9278): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9278)] 13:15:59.021736 run osmo-hlr_10.42.42.2(pid=9278): stdout: | (launched: 2022-12-09_13:15:56.115645) 13:15:59.071318 run osmo-hlr_10.42.42.2(pid=9278): stderr: | 20221209131556294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131556294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131556294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131556294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131556294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131556294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131556306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131556315 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131556316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131556316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:59.140514 run osmo-msc_10.42.42.6(pid=9284): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9284)] 13:15:59.188581 run osmo-msc_10.42.42.6(pid=9284): stdout: | (launched: 2022-12-09_13:15:58.058938) 13:15:59.238057 run osmo-msc_10.42.42.6(pid=9284): stderr: | 20221209131558334 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131558334 DLGLOBAL DEBUG validating counter group 0x7f8511894c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131558334 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131558334 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131558334 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131558334 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131558336 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131558337 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131558337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131558337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:15:59.288033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9277): Terminating (SIGTERM) 13:15:59.327966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9280): Terminating (SIGTERM) 13:15:59.367863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9283): Terminating (SIGTERM) 13:15:59.407853 --- ParallelTerminationStrategy: PID 9277 died... 13:15:59.426989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9277): Terminated: ok {rc=0} 13:15:59.470975 --- ParallelTerminationStrategy: PID 9280 died... 13:15:59.489577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9280): Terminated: ok {rc=0} 13:15:59.533368 --- ParallelTerminationStrategy: PID 9283 died... 13:15:59.552041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9283): Terminated: ok {rc=0} 13:15:59.636242 bus /sierra_3: Setting Powered False 13:16:00.733847 bus /sierra_3: Setting Powered False 13:16:01.852311 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:16:03.001288 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:16:03.013292 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:16:03.083704 tst mo_mt_call_osmux.py: using LAC 21712 13:16:03.203514 tst mo_mt_call_osmux.py: using RAC 37 13:16:03.325954 tst mo_mt_call_osmux.py: using CellId 21712 13:16:03.448715 tst mo_mt_call_osmux.py: using BVCI 21713 13:16:03.561558 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:16:03.572824 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:16:03.584074 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:16:03.595186 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:16:03.606387 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:16:03.617398 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:16:03.737566 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:16:03.859234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:04.368801 run create_hlr_db(pid=9286): Launched 13:16:04.494595 bus /sierra_2: Setting Powered False 13:16:05.559095 run create_hlr_db(pid=9286): Terminated: ok {rc=0} 13:16:06.014405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9288): Launched 13:16:06.344133 run osmo-hlr_10.42.42.2(pid=9289): Launched 13:16:06.470415 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:07.035275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9291): Launched 13:16:07.362446 run osmo-stp_10.42.42.5(pid=9292): Launched 13:16:07.488526 run osmo-msc_10.42.42.6: Starting osmo-msc 13:16:08.080254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9294): Launched 13:16:08.409220 run osmo-msc_10.42.42.6(pid=9295): Launched 13:16:08.591786 run osmo-stp_10.42.42.5(pid=9292): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9292)] 13:16:08.730161 run osmo-stp_10.42.42.5(pid=9292): stdout: | (launched: 2022-12-09_13:16:07.302313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:08.868811 run osmo-stp_10.42.42.5(pid=9292): stderr: | 20221209131607494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131607494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131607494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131607495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131607495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131607495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131607495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:09.007980 run osmo-stp_10.42.42.5(pid=9292): stdout: | (launched: 2022-12-09_13:16:07.302313) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:09.139211 run osmo-stp_10.42.42.5(pid=9292): stderr: | 20221209131607494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131607494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131607494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131607495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131607495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131607495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131607495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:09.295487 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9292): Process ended prematurely: osmo-stp_10.42.42.5(pid=9292) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9292)] [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:16:09.305469 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:16:09.334534 run osmo-hlr_10.42.42.2(pid=9289): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9289)] 13:16:09.385772 run osmo-hlr_10.42.42.2(pid=9289): stdout: | (launched: 2022-12-09_13:16:06.283844) 13:16:09.438407 run osmo-hlr_10.42.42.2(pid=9289): stderr: | 20221209131606483 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131606483 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131606483 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131606483 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131606483 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131606483 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131606496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131606504 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131606504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131606504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:09.512016 run osmo-msc_10.42.42.6(pid=9295): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9295)] 13:16:09.563143 run osmo-msc_10.42.42.6(pid=9295): stdout: | (launched: 2022-12-09_13:16:08.348532) 13:16:09.615621 run osmo-msc_10.42.42.6(pid=9295): stderr: | 20221209131608672 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131608672 DLGLOBAL DEBUG validating counter group 0x7f368c308c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131608672 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131608672 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131608673 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131608673 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131608674 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131608675 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131608675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131608675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:16:09.668771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9288): Terminating (SIGTERM) 13:16:09.711646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9291): Terminating (SIGTERM) 13:16:09.754556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9294): Terminating (SIGTERM) 13:16:09.797607 --- ParallelTerminationStrategy: PID 9288 died... 13:16:09.817813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9288): Terminated: ok {rc=0} 13:16:09.865640 --- ParallelTerminationStrategy: PID 9291 died... 13:16:09.885907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9291): Terminated: ok {rc=0} 13:16:09.933502 --- ParallelTerminationStrategy: PID 9294 died... 13:16:09.953487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9294): Terminated: ok {rc=0} 13:16:10.043249 bus /sierra_3: Setting Powered False 13:16:11.143242 bus /sierra_3: Setting Powered False 13:16:12.262174 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:16:13.522013 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:16:13.528695 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:16:13.564096 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:16:13.591322 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:16:13.642546 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:16:13.676566 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:16:13.703195 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:16:14.256738 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:16:14.306206 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:16:14.317611 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:16:14.389151 tst mo_mt_call.py: using LAC 21713 13:16:14.510594 tst mo_mt_call.py: using RAC 38 13:16:14.630141 tst mo_mt_call.py: using CellId 21713 13:16:14.758593 tst mo_mt_call.py: using BVCI 21714 13:16:14.879158 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:16:14.891127 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:16:14.902992 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:16:14.915105 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:16:14.927405 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:16:14.939496 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:16:15.057498 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:16:15.174496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:15.680108 run create_hlr_db(pid=9301): Launched 13:16:15.803980 bus /sierra_2: Setting Powered False 13:16:16.863223 run create_hlr_db(pid=9301): Terminated: ok {rc=0} 13:16:17.375783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9303): Launched 13:16:17.702475 run osmo-hlr_10.42.42.2(pid=9304): Launched 13:16:17.828802 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:18.391158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9306): Launched 13:16:18.716569 run osmo-stp_10.42.42.5(pid=9307): Launched 13:16:18.840734 run osmo-msc_10.42.42.6: Starting osmo-msc 13:16:19.429659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9309): Launched 13:16:19.755061 run osmo-msc_10.42.42.6(pid=9310): Launched 13:16:19.938630 run osmo-stp_10.42.42.5(pid=9307): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9307)] 13:16:20.075973 run osmo-stp_10.42.42.5(pid=9307): stdout: | (launched: 2022-12-09_13:16:18.656718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:20.214118 run osmo-stp_10.42.42.5(pid=9307): stderr: | 20221209131618849 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131618849 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131618849 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131618849 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131618850 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131618850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131618850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:20.351529 run osmo-stp_10.42.42.5(pid=9307): stdout: | (launched: 2022-12-09_13:16:18.656718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:20.481731 run osmo-stp_10.42.42.5(pid=9307): stderr: | 20221209131618849 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131618849 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131618849 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131618849 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131618850 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131618850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131618850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:20.637107 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9307): Process ended prematurely: osmo-stp_10.42.42.5(pid=9307) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9307)] [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:16:20.646963 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:16:20.675303 run osmo-hlr_10.42.42.2(pid=9304): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9304)] 13:16:20.726066 run osmo-hlr_10.42.42.2(pid=9304): stdout: | (launched: 2022-12-09_13:16:17.643217) 13:16:20.778115 run osmo-hlr_10.42.42.2(pid=9304): stderr: | 20221209131617840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131617840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131617840 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131617840 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131617840 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131617840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131617852 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131617861 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131617861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131617861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:20.850779 run osmo-msc_10.42.42.6(pid=9310): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9310)] 13:16:20.901730 run osmo-msc_10.42.42.6(pid=9310): stdout: | (launched: 2022-12-09_13:16:19.695735) 13:16:20.953778 run osmo-msc_10.42.42.6(pid=9310): stderr: | 20221209131620017 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131620017 DLGLOBAL DEBUG validating counter group 0x7fec7b313c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131620017 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131620017 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131620017 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131620017 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131620019 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131620019 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131620020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131620020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:16:21.006112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9303): Terminating (SIGTERM) 13:16:21.048080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9306): Terminating (SIGTERM) 13:16:21.090552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9309): Terminating (SIGTERM) 13:16:21.133035 --- ParallelTerminationStrategy: PID 9303 died... 13:16:21.152903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9303): Terminated: ok {rc=0} 13:16:21.199793 --- ParallelTerminationStrategy: PID 9306 died... 13:16:21.219471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9306): Terminated: ok {rc=0} 13:16:21.265965 --- ParallelTerminationStrategy: PID 9309 died... 13:16:21.285593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9309): Terminated: ok {rc=0} 13:16:21.374098 bus /sierra_3: Setting Powered False 13:16:22.473297 bus /sierra_3: Setting Powered False 13:16:23.589752 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:16:24.739731 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:16:24.752492 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:16:24.825971 tst mo_mt_call_osmux.py: using LAC 21714 13:16:24.960256 tst mo_mt_call_osmux.py: using RAC 39 13:16:25.087981 tst mo_mt_call_osmux.py: using CellId 21714 13:16:25.213983 tst mo_mt_call_osmux.py: using BVCI 21715 13:16:25.334496 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:16:25.346389 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:16:25.358036 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:16:25.370218 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:16:25.382340 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:16:25.394317 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:16:25.511817 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:16:25.628453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:26.101501 run create_hlr_db(pid=9312): Launched 13:16:26.226574 bus /sierra_2: Setting Powered False 13:16:27.286956 run create_hlr_db(pid=9312): Terminated: ok {rc=0} 13:16:27.711200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9314): Launched 13:16:28.016007 run osmo-hlr_10.42.42.2(pid=9315): Launched 13:16:28.131624 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:28.661382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9317): Launched 13:16:28.966416 run osmo-stp_10.42.42.5(pid=9318): Launched 13:16:29.081628 run osmo-msc_10.42.42.6: Starting osmo-msc 13:16:29.632897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9320): Launched 13:16:29.938555 run osmo-msc_10.42.42.6(pid=9321): Launched 13:16:30.109666 run osmo-stp_10.42.42.5(pid=9318): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9318)] 13:16:30.238470 run osmo-stp_10.42.42.5(pid=9318): stdout: | (launched: 2022-12-09_13:16:28.910356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:30.367773 run osmo-stp_10.42.42.5(pid=9318): stderr: | 20221209131629083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131629083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131629084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131629084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131629084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131629085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131629085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:30.494982 run osmo-stp_10.42.42.5(pid=9318): stdout: | (launched: 2022-12-09_13:16:28.910356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:30.616343 run osmo-stp_10.42.42.5(pid=9318): stderr: | 20221209131629083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131629083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131629084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131629084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131629084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131629085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131629085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:30.761896 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9318): Process ended prematurely: osmo-stp_10.42.42.5(pid=9318) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9318)] [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:16:30.770784 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:16:30.796841 run osmo-hlr_10.42.42.2(pid=9315): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9315)] 13:16:30.844438 run osmo-hlr_10.42.42.2(pid=9315): stdout: | (launched: 2022-12-09_13:16:27.959345) 13:16:30.894525 run osmo-hlr_10.42.42.2(pid=9315): stderr: | 20221209131628136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131628136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131628136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131628136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131628136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131628136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131628148 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131628157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131628157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131628158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:30.964091 run osmo-msc_10.42.42.6(pid=9321): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9321)] 13:16:31.012146 run osmo-msc_10.42.42.6(pid=9321): stdout: | (launched: 2022-12-09_13:16:29.882095) 13:16:31.062524 run osmo-msc_10.42.42.6(pid=9321): stderr: | 20221209131630154 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131630154 DLGLOBAL DEBUG validating counter group 0x7f09cfcecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131630154 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131630154 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131630154 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131630155 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131630156 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131630157 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131630157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131630157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:16:31.113205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9314): Terminating (SIGTERM) 13:16:31.153402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9317): Terminating (SIGTERM) 13:16:31.193576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9320): Terminating (SIGTERM) 13:16:31.234423 --- ParallelTerminationStrategy: PID 9314 died... 13:16:31.253671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9314): Terminated: ok {rc=0} 13:16:31.299603 --- ParallelTerminationStrategy: PID 9317 died... 13:16:31.318810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9317): Terminated: ok {rc=0} 13:16:31.363919 --- ParallelTerminationStrategy: PID 9320 died... 13:16:31.383309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9320): Terminated: ok {rc=0} 13:16:31.468566 bus /sierra_3: Setting Powered False 13:16:32.564596 bus /sierra_3: Setting Powered False 13:16:33.680038 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:16:34.934902 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:16:34.942110 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:16:34.976214 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:16:35.002795 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:16:35.052710 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:16:35.085838 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:16:35.112055 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:16:35.664473 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:16:35.713528 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:16:35.724565 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:16:35.794288 tst mo_mt_call.py: using LAC 21715 13:16:35.913392 tst mo_mt_call.py: using RAC 40 13:16:36.033729 tst mo_mt_call.py: using CellId 21715 13:16:36.152519 tst mo_mt_call.py: using BVCI 21716 13:16:36.263194 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:16:36.274280 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:16:36.285116 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:16:36.295863 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:16:36.306825 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:16:36.317625 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:16:36.435707 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:16:36.552069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:37.027646 run create_hlr_db(pid=9327): Launched 13:16:37.153375 bus /sierra_2: Setting Powered False 13:16:38.214276 run create_hlr_db(pid=9327): Terminated: ok {rc=0} 13:16:38.639839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9329): Launched 13:16:38.946378 run osmo-hlr_10.42.42.2(pid=9330): Launched 13:16:39.064469 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:39.606037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9332): Launched 13:16:39.913641 run osmo-stp_10.42.42.5(pid=9333): Launched 13:16:40.029583 run osmo-msc_10.42.42.6: Starting osmo-msc 13:16:40.583049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9335): Launched 13:16:40.889372 run osmo-msc_10.42.42.6(pid=9336): Launched 13:16:41.060335 run osmo-stp_10.42.42.5(pid=9333): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9333)] 13:16:41.189854 run osmo-stp_10.42.42.5(pid=9333): stdout: | (launched: 2022-12-09_13:16:39.857361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:41.318500 run osmo-stp_10.42.42.5(pid=9333): stderr: | 20221209131640028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131640028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131640028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131640029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131640029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131640029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131640030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:41.445552 run osmo-stp_10.42.42.5(pid=9333): stdout: | (launched: 2022-12-09_13:16:39.857361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:41.567776 run osmo-stp_10.42.42.5(pid=9333): stderr: | 20221209131640028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131640028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131640028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131640029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131640029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131640029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131640030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:41.713878 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9333): Process ended prematurely: osmo-stp_10.42.42.5(pid=9333) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9333)] [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:16:41.722672 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:16:41.748824 run osmo-hlr_10.42.42.2(pid=9330): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9330)] 13:16:41.796091 run osmo-hlr_10.42.42.2(pid=9330): stdout: | (launched: 2022-12-09_13:16:38.889988) 13:16:41.845295 run osmo-hlr_10.42.42.2(pid=9330): stderr: | 20221209131639065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131639065 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131639065 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131639065 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131639065 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131639065 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131639076 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131639084 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131639084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131639084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:41.913728 run osmo-msc_10.42.42.6(pid=9336): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9336)] 13:16:41.961132 run osmo-msc_10.42.42.6(pid=9336): stdout: | (launched: 2022-12-09_13:16:40.832547) 13:16:42.010205 run osmo-msc_10.42.42.6(pid=9336): stderr: | 20221209131641107 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131641107 DLGLOBAL DEBUG validating counter group 0x7f39d7073c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131641107 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131641107 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131641107 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131641107 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131641110 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131641111 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131641111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131641111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:16:42.059595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9329): Terminating (SIGTERM) 13:16:42.099193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9332): Terminating (SIGTERM) 13:16:42.138751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9335): Terminating (SIGTERM) 13:16:42.178542 --- ParallelTerminationStrategy: PID 9329 died... 13:16:42.197536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9329): Terminated: ok {rc=0} 13:16:42.241191 --- ParallelTerminationStrategy: PID 9332 died... 13:16:42.259610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9332): Terminated: ok {rc=0} 13:16:42.303698 --- ParallelTerminationStrategy: PID 9335 died... 13:16:42.322385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9335): Terminated: ok {rc=0} 13:16:42.406008 bus /sierra_3: Setting Powered False 13:16:43.504703 bus /sierra_3: Setting Powered False 13:16:44.626013 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:16:45.773537 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:16:45.785572 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:16:45.871801 tst mo_mt_call_osmux.py: using LAC 21716 13:16:46.000758 tst mo_mt_call_osmux.py: using RAC 41 13:16:46.124478 tst mo_mt_call_osmux.py: using CellId 21716 13:16:46.256553 tst mo_mt_call_osmux.py: using BVCI 21717 13:16:46.411742 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:16:46.424340 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:16:46.437654 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:16:46.450194 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:16:46.462190 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:16:46.474636 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:16:46.592825 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:16:46.745253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:47.297242 run create_hlr_db(pid=9338): Launched 13:16:47.424040 bus /sierra_2: Setting Powered False 13:16:48.487848 run create_hlr_db(pid=9338): Terminated: ok {rc=0} 13:16:48.942030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9340): Launched 13:16:49.268746 run osmo-hlr_10.42.42.2(pid=9341): Launched 13:16:49.395368 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:49.959442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9343): Launched 13:16:50.286902 run osmo-stp_10.42.42.5(pid=9344): Launched 13:16:50.412505 run osmo-msc_10.42.42.6: Starting osmo-msc 13:16:51.001851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9346): Launched 13:16:51.327050 run osmo-msc_10.42.42.6(pid=9347): Launched 13:16:51.509704 run osmo-stp_10.42.42.5(pid=9344): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9344)] 13:16:51.647599 run osmo-stp_10.42.42.5(pid=9344): stdout: | (launched: 2022-12-09_13:16:50.227536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:51.785724 run osmo-stp_10.42.42.5(pid=9344): stderr: | 20221209131650419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131650420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131650420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131650420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131650421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131650421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131650421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:51.923564 run osmo-stp_10.42.42.5(pid=9344): stdout: | (launched: 2022-12-09_13:16:50.227536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:52.053486 run osmo-stp_10.42.42.5(pid=9344): stderr: | 20221209131650419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131650420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131650420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131650420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131650421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131650421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131650421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:52.208910 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9344): Process ended prematurely: osmo-stp_10.42.42.5(pid=9344) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9344)] [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:16:52.218552 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 13:16:52.246455 run osmo-hlr_10.42.42.2(pid=9341): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9341)] 13:16:52.296899 run osmo-hlr_10.42.42.2(pid=9341): stdout: | (launched: 2022-12-09_13:16:49.209538) 13:16:52.348800 run osmo-hlr_10.42.42.2(pid=9341): stderr: | 20221209131649408 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131649408 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131649408 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131649408 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131649408 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131649408 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131649421 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131649429 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131649429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131649430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:52.421326 run osmo-msc_10.42.42.6(pid=9347): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9347)] 13:16:52.471775 run osmo-msc_10.42.42.6(pid=9347): stdout: | (launched: 2022-12-09_13:16:51.267498) 13:16:52.523833 run osmo-msc_10.42.42.6(pid=9347): stderr: | 20221209131651590 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131651590 DLGLOBAL DEBUG validating counter group 0x7f0597857c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131651590 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131651590 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131651590 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131651591 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131651592 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131651593 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131651593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131651593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:16:52.576567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9340): Terminating (SIGTERM) 13:16:52.618499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9343): Terminating (SIGTERM) 13:16:52.660433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9346): Terminating (SIGTERM) 13:16:52.702650 --- ParallelTerminationStrategy: PID 9340 died... 13:16:52.722592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9340): Terminated: ok {rc=0} 13:16:52.769307 --- ParallelTerminationStrategy: PID 9343 died... 13:16:52.788890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9343): Terminated: ok {rc=0} 13:16:52.835435 --- ParallelTerminationStrategy: PID 9346 died... 13:16:52.855015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9346): Terminated: ok {rc=0} 13:16:52.943503 bus /sierra_3: Setting Powered False 13:16:54.043213 bus /sierra_3: Setting Powered False 13:16:55.160312 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 13:16:56.417129 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:16:56.422355 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:16:56.458594 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 13:16:56.486736 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 13:16:56.573125 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:16:56.608316 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 13:16:56.636170 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 13:16:57.222546 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2360 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 13:16:57.228067 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:16:57.239568 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:16:57.292918 tst emergency_mo_mt_call.py: using LAC 21717 13:16:57.419999 tst emergency_mo_mt_call.py: using RAC 42 13:16:57.545416 tst emergency_mo_mt_call.py: using CellId 21717 13:16:57.662140 tst emergency_mo_mt_call.py: using BVCI 21718 13:16:57.770892 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:16:57.782018 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:16:57.792848 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:16:57.803949 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:16:57.814931 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:16:57.825811 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:16:57.941545 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:16:58.059031 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:58.555004 run create_hlr_db(pid=9352): Launched 13:16:58.678316 bus /sierra_2: Setting Powered False 13:16:59.741862 run create_hlr_db(pid=9352): Terminated: ok {rc=0} 13:17:00.188455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9354): Launched 13:17:00.508402 run osmo-hlr_10.42.42.2(pid=9355): Launched 13:17:00.632500 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:01.214743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9357): Launched 13:17:01.549953 run osmo-stp_10.42.42.5(pid=9361): Launched 13:17:01.736030 tst emergency_mo_mt_call.py: using MSISDN 7228 13:17:01.967110 run osmo-msc_10.42.42.6: Starting osmo-msc 13:17:02.540820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9363): Launched 13:17:02.843781 run osmo-msc_10.42.42.6(pid=9364): Launched 13:17:03.011805 run osmo-stp_10.42.42.5(pid=9361): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9361)] 13:17:03.138780 run osmo-stp_10.42.42.5(pid=9361): stdout: | (launched: 2022-12-09_13:17:01.492068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:03.265949 run osmo-stp_10.42.42.5(pid=9361): stderr: | 20221209131701818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131701818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131701818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131701819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131701819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131701819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131701819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:03.392170 run osmo-stp_10.42.42.5(pid=9361): stdout: | (launched: 2022-12-09_13:17:01.492068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:03.511824 run osmo-stp_10.42.42.5(pid=9361): stderr: | 20221209131701818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131701818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131701818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131701819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131701819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131701819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131701819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:03.655178 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=9361): Process ended prematurely: osmo-stp_10.42.42.5(pid=9361) [trial-2360↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9361)] [trial-2360↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 13:17:03.665580 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 13:17:03.691920 run osmo-hlr_10.42.42.2(pid=9355): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9355)] 13:17:03.740134 run osmo-hlr_10.42.42.2(pid=9355): stdout: | (launched: 2022-12-09_13:17:00.449474) 13:17:03.790464 run osmo-hlr_10.42.42.2(pid=9355): stderr: | 20221209131700647 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131700647 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131700647 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131700647 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131700647 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131700648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131700665 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131700673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131700673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131700673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:03.860318 run osmo-msc_10.42.42.6(pid=9364): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9364)] 13:17:03.908817 run osmo-msc_10.42.42.6(pid=9364): stdout: | (launched: 2022-12-09_13:17:02.787309) 13:17:03.958954 run osmo-msc_10.42.42.6(pid=9364): stderr: | 20221209131703060 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131703060 DLGLOBAL DEBUG validating counter group 0x7f6dbe6abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131703060 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131703060 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131703061 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131703061 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131703064 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131703064 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131703064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131703064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:17:04.009356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9354): Terminating (SIGTERM) 13:17:04.050010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9357): Terminating (SIGTERM) 13:17:04.090811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9363): Terminating (SIGTERM) 13:17:04.131547 --- ParallelTerminationStrategy: PID 9354 died... 13:17:04.150769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9354): Terminated: ok {rc=0} 13:17:04.195082 --- ParallelTerminationStrategy: PID 9357 died... 13:17:04.213774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9357): Terminated: ok {rc=0} 13:17:04.257701 --- ParallelTerminationStrategy: PID 9363 died... 13:17:04.276360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9363): Terminated: ok {rc=0} 13:17:04.360705 bus /sierra_3: Setting Powered False 13:17:05.458926 bus /sierra_3: Setting Powered False 13:17:06.580003 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 13:17:07.670065 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:17:07.682502 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:17:07.737050 tst emergency_preemptive_call.py: using LAC 21718 13:17:07.862243 tst emergency_preemptive_call.py: using RAC 43 13:17:07.987932 tst emergency_preemptive_call.py: using CellId 21718 13:17:08.116587 tst emergency_preemptive_call.py: using BVCI 21719 13:17:08.233457 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:17:08.245117 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:17:08.256511 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:17:08.268364 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:17:08.280186 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:17:08.292062 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:17:08.410057 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:17:08.529858 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:17:08.647220 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:17:08.762213 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:09.231599 run create_hlr_db(pid=9366): Launched 13:17:09.355837 bus /sierra_2: Setting Powered False 13:17:10.417187 run create_hlr_db(pid=9366): Terminated: ok {rc=0} 13:17:10.859156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9368): Launched 13:17:11.183575 run osmo-hlr_10.42.42.2(pid=9369): Launched 13:17:11.306512 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:11.867002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9371): Launched 13:17:12.191402 run osmo-stp_10.42.42.5(pid=9372): Launched 13:17:12.327505 tst emergency_preemptive_call.py: using MSISDN 7229 13:17:12.492027 run osmo-msc_10.42.42.6: Starting osmo-msc 13:17:13.070087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9374): Launched 13:17:13.391698 run osmo-msc_10.42.42.6(pid=9375): Launched 13:17:13.570781 run osmo-stp_10.42.42.5(pid=9372): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9372)] 13:17:13.706396 run osmo-stp_10.42.42.5(pid=9372): stdout: | (launched: 2022-12-09_13:17:12.132188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:13.843054 run osmo-stp_10.42.42.5(pid=9372): stderr: | 20221209131712327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131712327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131712328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131712328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131712329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131712329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131712329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:13.979752 run osmo-stp_10.42.42.5(pid=9372): stdout: | (launched: 2022-12-09_13:17:12.132188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:14.107795 run osmo-stp_10.42.42.5(pid=9372): stderr: | 20221209131712327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131712327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131712328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131712328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131712329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131712329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131712329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:14.261007 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=9372): Process ended prematurely: osmo-stp_10.42.42.5(pid=9372) [trial-2360↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9372)] [trial-2360↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 13:17:14.270212 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 13:17:14.298842 run osmo-hlr_10.42.42.2(pid=9369): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9369)] 13:17:14.350395 run osmo-hlr_10.42.42.2(pid=9369): stdout: | (launched: 2022-12-09_13:17:11.124785) 13:17:14.403774 run osmo-hlr_10.42.42.2(pid=9369): stderr: | 20221209131711322 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131711322 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131711322 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131711322 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131711323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131711323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131711334 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131711343 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131711343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131711343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:14.478053 run osmo-msc_10.42.42.6(pid=9375): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9375)] 13:17:14.529263 run osmo-msc_10.42.42.6(pid=9375): stdout: | (launched: 2022-12-09_13:17:13.332565) 13:17:14.582146 run osmo-msc_10.42.42.6(pid=9375): stderr: | 20221209131713655 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209131713655 DLGLOBAL DEBUG validating counter group 0x7fa68a497c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209131713656 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209131713656 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209131713656 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209131713656 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209131713658 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209131713658 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209131713658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209131713659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:17:14.635667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9368): Terminating (SIGTERM) 13:17:14.678818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9371): Terminating (SIGTERM) 13:17:14.722412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9374): Terminating (SIGTERM) 13:17:14.765529 --- ParallelTerminationStrategy: PID 9368 died... 13:17:14.785819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9368): Terminated: ok {rc=0} 13:17:14.833515 --- ParallelTerminationStrategy: PID 9371 died... 13:17:14.853451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9371): Terminated: ok {rc=0} 13:17:14.900610 --- ParallelTerminationStrategy: PID 9374 died... 13:17:14.920897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9374): Terminated: ok {rc=0} 13:17:15.009850 bus /sierra_9: Setting Powered False 13:17:16.109048 bus /sierra_9: Setting Powered False 13:17:17.226890 bus /sierra_8: Setting Powered False 13:17:18.326445 bus /sierra_8: Setting Powered False 13:17:19.446884 bus /sierra_3: Setting Powered False 13:17:20.548077 bus /sierra_3: Setting Powered False 13:17:21.665535 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 13:17:22.958246 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:17:22.963408 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:17:22.997443 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 13:17:23.035730 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 13:17:23.126366 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:17:23.161643 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 13:17:23.201654 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 13:17:23.797566 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 13:17:23.851839 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:23.863373 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:17:23.913394 tst cs_paging_gprs_active.py: using LAC 21719 13:17:24.039746 tst cs_paging_gprs_active.py: using RAC 44 13:17:24.165933 tst cs_paging_gprs_active.py: using CellId 21719 13:17:24.292879 tst cs_paging_gprs_active.py: using BVCI 21720 13:17:24.412156 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:24.423634 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:24.434836 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:24.446528 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:24.458549 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:24.470274 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:24.482049 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:24.493587 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:24.505435 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:17:24.625426 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:17:24.745496 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:17:24.968824 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:25.297529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9380): Launched 13:17:25.583109 run iperf3-srv_10.42.42.10(pid=9381): Launched 13:17:25.706289 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:17:25.927166 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:26.256335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9382): Launched 13:17:26.524720 run iperf3-srv_10.42.42.10(pid=9383): Launched 13:17:26.640303 tst cs_paging_gprs_active.py:38: start network... 13:17:26.846319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:27.323070 run create_hlr_db(pid=9384): Launched 13:17:27.449919 bus /sierra_2: Setting Powered False 13:17:28.510844 run create_hlr_db(pid=9384): Terminated: ok {rc=0} 13:17:28.959183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9386): Launched 13:17:29.287311 run osmo-hlr_10.42.42.2(pid=9387): Launched 13:17:29.413640 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:29.963603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9389): Launched 13:17:30.271452 run osmo-stp_10.42.42.5(pid=9390): Launched 13:17:30.389043 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:17:30.943533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9392): Launched 13:17:31.093766 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:17:31.361342 run patchelf(pid=9393): Launched 13:17:31.563403 run osmo-stp_10.42.42.5(pid=9390): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9390)] 13:17:31.697687 run osmo-stp_10.42.42.5(pid=9390): stdout: | (launched: 2022-12-09_13:17:30.215285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:31.832707 run osmo-stp_10.42.42.5(pid=9390): stderr: | 20221209131730383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131730383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131730383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131730383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131730384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131730384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131730384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:31.968114 run osmo-stp_10.42.42.5(pid=9390): stdout: | (launched: 2022-12-09_13:17:30.215285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:32.096796 run osmo-stp_10.42.42.5(pid=9390): stderr: | 20221209131730383 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131730383 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131730383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131730383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131730384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131730384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131730384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:32.248859 run patchelf(pid=9393): Terminating (SIGINT) 13:17:32.421701 run patchelf(pid=9393): Terminated: ok {rc=0} 13:17:32.545930 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9390): Process ended prematurely: osmo-stp_10.42.42.5(pid=9390) [trial-2360↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9390)] [trial-2360↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 13:17:32.555644 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:17:32.583246 run osmo-hlr_10.42.42.2(pid=9387): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9387)] 13:17:32.631295 run osmo-hlr_10.42.42.2(pid=9387): stdout: | (launched: 2022-12-09_13:17:29.227233) 13:17:32.681341 run osmo-hlr_10.42.42.2(pid=9387): stderr: | 20221209131729425 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131729425 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131729425 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131729425 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131729425 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131729425 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131729438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131729447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131729447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131729447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:32.731426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9380): Terminating (SIGTERM) 13:17:32.771440 run iperf3-srv_10.42.42.10(pid=9381): Terminating (SIGTERM) 13:17:32.811334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9382): Terminating (SIGTERM) 13:17:32.851659 run iperf3-srv_10.42.42.10(pid=9383): Terminating (SIGTERM) 13:17:32.891802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9386): Terminating (SIGTERM) 13:17:32.931815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9389): Terminating (SIGTERM) 13:17:32.971660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9392): Terminating (SIGTERM) 13:17:33.011683 --- ParallelTerminationStrategy: PID 9380 died... 13:17:33.030911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9380): Terminated: ok {rc=0} 13:17:33.075438 --- ParallelTerminationStrategy: PID 9381 died... 13:17:33.094155 run iperf3-srv_10.42.42.10(pid=9381): Terminated {rc=256} 13:17:33.138115 --- ParallelTerminationStrategy: PID 9382 died... 13:17:33.156887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9382): Terminated: ok {rc=0} 13:17:33.201267 --- ParallelTerminationStrategy: PID 9383 died... 13:17:33.219954 run iperf3-srv_10.42.42.10(pid=9383): Terminated {rc=256} 13:17:33.264106 --- ParallelTerminationStrategy: PID 9386 died... 13:17:33.282990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9386): Terminated: ok {rc=0} 13:17:33.327287 --- ParallelTerminationStrategy: PID 9389 died... 13:17:33.346166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9389): Terminated: ok {rc=0} 13:17:33.391029 --- ParallelTerminationStrategy: PID 9392 died... 13:17:33.410125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9392): Terminated: ok {rc=0} 13:17:33.498015 bus /gobi_0: Setting Powered False 13:17:34.599664 bus /gobi_0: Setting Powered False 13:17:35.718271 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 13:17:36.865814 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:36.877859 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:17:36.934674 tst iperf3.py: using LAC 21720 13:17:37.064098 tst iperf3.py: using RAC 45 13:17:37.190775 tst iperf3.py: using CellId 21720 13:17:37.319060 tst iperf3.py: using BVCI 21721 13:17:37.439943 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:37.451542 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:37.462816 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:37.474532 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:37.486275 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:37.498775 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:37.510703 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:37.521651 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:37.533671 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:17:37.655924 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:17:37.877321 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:38.206862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9394): Launched 13:17:38.491133 run iperf3-srv_10.42.42.10(pid=9395): Launched 13:17:38.615558 tst iperf3.py:8: start network... 13:17:38.836236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:39.345736 run create_hlr_db(pid=9396): Launched 13:17:39.470364 bus /gobi_6: Setting Powered False 13:17:40.534978 run create_hlr_db(pid=9396): Terminated: ok {rc=0} 13:17:40.973423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9398): Launched 13:17:41.281880 run osmo-hlr_10.42.42.2(pid=9399): Launched 13:17:41.399390 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:41.930959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9401): Launched 13:17:42.238922 run osmo-stp_10.42.42.5(pid=9402): Launched 13:17:42.356137 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:17:42.885958 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9404): Launched 13:17:43.003926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:17:43.263949 run patchelf(pid=9405): Launched 13:17:43.434302 run osmo-stp_10.42.42.5(pid=9402): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9402)] 13:17:43.564193 run osmo-stp_10.42.42.5(pid=9402): stdout: | (launched: 2022-12-09_13:17:42.182025) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:43.695271 run osmo-stp_10.42.42.5(pid=9402): stderr: | 20221209131742352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131742352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131742353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131742353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131742354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131742354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131742354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:43.826429 run osmo-stp_10.42.42.5(pid=9402): stdout: | (launched: 2022-12-09_13:17:42.182025) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:43.952119 run osmo-stp_10.42.42.5(pid=9402): stderr: | 20221209131742352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131742352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131742353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131742353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131742354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131742354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131742354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:44.101131 run patchelf(pid=9405): Terminating (SIGINT) 13:17:44.272232 run patchelf(pid=9405): Terminated: ok {rc=0} 13:17:44.395621 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9402): Process ended prematurely: osmo-stp_10.42.42.5(pid=9402) [trial-2360↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9402)] [trial-2360↪gprs:trx-sysmocell5000↪iperf3.py:8] 13:17:44.405187 tst iperf3.py:8: Test FAILED (7.6 sec) 13:17:44.432208 run osmo-hlr_10.42.42.2(pid=9399): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9399)] 13:17:44.479791 run osmo-hlr_10.42.42.2(pid=9399): stdout: | (launched: 2022-12-09_13:17:41.224441) 13:17:44.529447 run osmo-hlr_10.42.42.2(pid=9399): stderr: | 20221209131741404 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131741404 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131741404 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131741404 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131741404 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131741404 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131741416 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131741427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131741427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131741427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:44.579550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9394): Terminating (SIGTERM) 13:17:44.619434 run iperf3-srv_10.42.42.10(pid=9395): Terminating (SIGTERM) 13:17:44.659482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9398): Terminating (SIGTERM) 13:17:44.699140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9401): Terminating (SIGTERM) 13:17:44.738699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9404): Terminating (SIGTERM) 13:17:44.778578 --- ParallelTerminationStrategy: PID 9394 died... 13:17:44.797689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9394): Terminated: ok {rc=0} 13:17:44.841696 --- ParallelTerminationStrategy: PID 9395 died... 13:17:44.860291 run iperf3-srv_10.42.42.10(pid=9395): Terminated {rc=256} 13:17:44.904076 --- ParallelTerminationStrategy: PID 9398 died... 13:17:44.922713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9398): Terminated: ok {rc=0} 13:17:44.966972 --- ParallelTerminationStrategy: PID 9401 died... 13:17:44.985764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9401): Terminated: ok {rc=0} 13:17:45.029634 --- ParallelTerminationStrategy: PID 9404 died... 13:17:45.048175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9404): Terminated: ok {rc=0} 13:17:45.133739 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 13:17:46.283475 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:46.295598 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:17:46.346442 tst iperf3m4.py: using LAC 21721 13:17:46.468524 tst iperf3m4.py: using RAC 46 13:17:46.591212 tst iperf3m4.py: using CellId 21721 13:17:46.727888 tst iperf3m4.py: using BVCI 21722 13:17:46.843196 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:46.854865 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:46.866205 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:46.877497 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:46.888599 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:46.899846 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:46.911287 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:46.922650 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:17:46.934094 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:17:47.049911 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:17:47.171602 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:17:47.290274 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:17:47.410656 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:17:47.633091 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:47.962740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9406): Launched 13:17:48.250449 run iperf3-srv_10.42.42.10(pid=9407): Launched 13:17:48.374377 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:17:48.595209 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:48.908794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9408): Launched 13:17:49.176829 run iperf3-srv_10.42.42.10(pid=9409): Launched 13:17:49.291790 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:17:49.496685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:49.805136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9410): Launched 13:17:50.072517 run iperf3-srv_10.42.42.10(pid=9411): Launched 13:17:50.187603 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:17:50.392929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:50.700291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9412): Launched 13:17:50.967674 run iperf3-srv_10.42.42.10(pid=9413): Launched 13:17:51.083558 tst iperf3m4.py:8: start network... 13:17:51.288681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:51.763505 run create_hlr_db(pid=9414): Launched 13:17:51.890252 bus /gobi_6: Setting Powered False 13:17:52.951560 run create_hlr_db(pid=9414): Terminated: ok {rc=0} 13:17:53.399651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9416): Launched 13:17:53.727845 run osmo-hlr_10.42.42.2(pid=9417): Launched 13:17:53.853193 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:54.419949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9419): Launched 13:17:54.751586 run osmo-stp_10.42.42.5(pid=9420): Launched 13:17:54.879984 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:17:55.449049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9422): Launched 13:17:55.574362 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:17:55.852328 run patchelf(pid=9423): Launched 13:17:56.035187 run osmo-stp_10.42.42.5(pid=9420): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9420)] 13:17:56.174807 run osmo-stp_10.42.42.5(pid=9420): stdout: | (launched: 2022-12-09_13:17:54.691239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:56.315745 run osmo-stp_10.42.42.5(pid=9420): stderr: | 20221209131754881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131754881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131754881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131754882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131754882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131754882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131754882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:56.456283 run osmo-stp_10.42.42.5(pid=9420): stdout: | (launched: 2022-12-09_13:17:54.691239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:56.591594 run osmo-stp_10.42.42.5(pid=9420): stderr: | 20221209131754881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131754881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131754881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131754882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131754882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131754882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131754882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:56.751602 run patchelf(pid=9423): Terminating (SIGINT) 13:17:56.935334 run patchelf(pid=9423): Terminated: ok {rc=0} 13:17:57.067882 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9420): Process ended prematurely: osmo-stp_10.42.42.5(pid=9420) [trial-2360↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9420)] [trial-2360↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 13:17:57.078245 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:17:57.107904 run osmo-hlr_10.42.42.2(pid=9417): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9417)] 13:17:57.158998 run osmo-hlr_10.42.42.2(pid=9417): stdout: | (launched: 2022-12-09_13:17:53.667705) 13:17:57.211764 run osmo-hlr_10.42.42.2(pid=9417): stderr: | 20221209131753863 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131753863 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131753863 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131753863 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131753863 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131753864 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131753875 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131753884 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131753884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131753884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:57.265284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9406): Terminating (SIGTERM) 13:17:57.307844 run iperf3-srv_10.42.42.10(pid=9407): Terminating (SIGTERM) 13:17:57.350545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9408): Terminating (SIGTERM) 13:17:57.393303 run iperf3-srv_10.42.42.10(pid=9409): Terminating (SIGTERM) 13:17:57.435778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9410): Terminating (SIGTERM) 13:17:57.478458 run iperf3-srv_10.42.42.10(pid=9411): Terminating (SIGTERM) 13:17:57.520935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9412): Terminating (SIGTERM) 13:17:57.563425 run iperf3-srv_10.42.42.10(pid=9413): Terminating (SIGTERM) 13:17:57.605896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9416): Terminating (SIGTERM) 13:17:57.648526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9419): Terminating (SIGTERM) 13:17:57.691175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9422): Terminating (SIGTERM) 13:17:57.733969 --- ParallelTerminationStrategy: PID 9406 died... 13:17:57.754249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9406): Terminated: ok {rc=0} 13:17:57.801326 --- ParallelTerminationStrategy: PID 9407 died... 13:17:57.821097 run iperf3-srv_10.42.42.10(pid=9407): Terminated {rc=256} 13:17:57.867799 --- ParallelTerminationStrategy: PID 9408 died... 13:17:57.887522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9408): Terminated: ok {rc=0} 13:17:57.934641 --- ParallelTerminationStrategy: PID 9409 died... 13:17:57.954282 run iperf3-srv_10.42.42.10(pid=9409): Terminated {rc=256} 13:17:58.000923 --- ParallelTerminationStrategy: PID 9410 died... 13:17:58.020914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9410): Terminated: ok {rc=0} 13:17:58.067307 --- ParallelTerminationStrategy: PID 9411 died... 13:17:58.087186 run iperf3-srv_10.42.42.10(pid=9411): Terminated {rc=256} 13:17:58.133911 --- ParallelTerminationStrategy: PID 9412 died... 13:17:58.153618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9412): Terminated: ok {rc=0} 13:17:58.200290 --- ParallelTerminationStrategy: PID 9413 died... 13:17:58.219982 run iperf3-srv_10.42.42.10(pid=9413): Terminated {rc=256} 13:17:58.266692 --- ParallelTerminationStrategy: PID 9416 died... 13:17:58.286530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9416): Terminated: ok {rc=0} 13:17:58.333633 --- ParallelTerminationStrategy: PID 9419 died... 13:17:58.353459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9419): Terminated: ok {rc=0} 13:17:58.400281 --- ParallelTerminationStrategy: PID 9422 died... 13:17:58.420117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9422): Terminated: ok {rc=0} 13:17:58.509031 bus /gobi_4: Setting Powered False 13:17:59.606331 bus /gobi_4: Setting Powered False 13:18:00.721870 bus /gobi_1: Setting Powered False 13:18:01.823171 bus /gobi_1: Setting Powered False 13:18:02.953504 bus /gobi_0: Setting Powered False 13:18:04.052216 bus /gobi_0: Setting Powered False 13:18:05.170634 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 13:18:06.274896 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:18:06.286966 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:18:06.340349 tst ping.py: using LAC 21722 13:18:06.467109 tst ping.py: using RAC 47 13:18:06.593458 tst ping.py: using CellId 21722 13:18:06.725565 tst ping.py: using BVCI 21723 13:18:06.844819 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:18:06.856347 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:18:06.867791 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:18:06.879393 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:18:06.891088 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:18:06.902883 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:18:06.914722 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:18:06.926514 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:18:07.046600 tst ping.py:19: start network... 13:18:07.264035 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:07.760200 run create_hlr_db(pid=9424): Launched 13:18:07.883057 bus /gobi_6: Setting Powered False 13:18:08.946686 run create_hlr_db(pid=9424): Terminated: ok {rc=0} 13:18:09.376586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9426): Launched 13:18:09.678278 run osmo-hlr_10.42.42.2(pid=9427): Launched 13:18:09.792552 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:10.316930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9429): Launched 13:18:10.618042 run osmo-stp_10.42.42.5(pid=9430): Launched 13:18:10.733546 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:18:11.254471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9432): Launched 13:18:11.368940 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:18:11.622942 run patchelf(pid=9433): Launched 13:18:11.790426 run osmo-stp_10.42.42.5(pid=9430): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9430)] 13:18:11.918042 run osmo-stp_10.42.42.5(pid=9430): stdout: | (launched: 2022-12-09_13:18:10.562413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:12.047082 run osmo-stp_10.42.42.5(pid=9430): stderr: | 20221209131810738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131810738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131810738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131810739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131810739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131810739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131810739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:12.176344 run osmo-stp_10.42.42.5(pid=9430): stdout: | (launched: 2022-12-09_13:18:10.562413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:12.299463 run osmo-stp_10.42.42.5(pid=9430): stderr: | 20221209131810738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131810738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131810738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131810739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131810739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131810739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131810739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:12.445554 run patchelf(pid=9433): Terminating (SIGINT) 13:18:12.613846 run patchelf(pid=9433): Terminated: ok {rc=0} 13:18:12.735363 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9430): Process ended prematurely: osmo-stp_10.42.42.5(pid=9430) [trial-2360↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9430)] [trial-2360↪gprs:trx-sysmocell5000↪ping.py:22] 13:18:12.744197 tst ping.py:22: Test FAILED (6.5 sec) 13:18:12.771026 run osmo-hlr_10.42.42.2(pid=9427): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9427)] 13:18:12.819208 run osmo-hlr_10.42.42.2(pid=9427): stdout: | (launched: 2022-12-09_13:18:09.622514) 13:18:12.869147 run osmo-hlr_10.42.42.2(pid=9427): stderr: | 20221209131809798 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131809798 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131809798 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131809798 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131809798 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131809798 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131809810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131809821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131809821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131809821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:12.919159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9426): Terminating (SIGTERM) 13:18:12.959576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9429): Terminating (SIGTERM) 13:18:12.999588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9432): Terminating (SIGTERM) 13:18:13.040069 --- ParallelTerminationStrategy: PID 9426 died... 13:18:13.058965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9426): Terminated: ok {rc=0} 13:18:13.103164 --- ParallelTerminationStrategy: PID 9429 died... 13:18:13.122083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9429): Terminated: ok {rc=0} 13:18:13.166410 --- ParallelTerminationStrategy: PID 9432 died... 13:18:13.185713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9432): Terminated: ok {rc=0} 13:18:13.271701 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 13:18:14.361389 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:18:14.373426 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:18:14.424747 tst ping_idle_ping.py: using LAC 21723 13:18:14.549135 tst ping_idle_ping.py: using RAC 48 13:18:14.666487 tst ping_idle_ping.py: using CellId 21723 13:18:14.784690 tst ping_idle_ping.py: using BVCI 21724 13:18:14.893649 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:18:14.904423 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:18:14.915056 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:18:14.925669 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:18:14.936119 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:18:14.946635 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:18:14.957533 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:18:14.968033 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:18:15.080744 tst ping_idle_ping.py:24: start network... 13:18:15.284023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:15.755614 run create_hlr_db(pid=9434): Launched 13:18:15.889161 bus /gobi_6: Setting Powered False 13:18:16.952240 run create_hlr_db(pid=9434): Terminated: ok {rc=0} 13:18:17.412793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9436): Launched 13:18:17.738603 run osmo-hlr_10.42.42.2(pid=9437): Launched 13:18:17.868405 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:18.428062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9439): Launched 13:18:18.750721 run osmo-stp_10.42.42.5(pid=9440): Launched 13:18:18.874741 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:18:19.431745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9442): Launched 13:18:19.556693 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:18:19.829096 run patchelf(pid=9443): Launched 13:18:20.008919 run osmo-stp_10.42.42.5(pid=9440): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9440)] 13:18:20.145812 run osmo-stp_10.42.42.5(pid=9440): stdout: | (launched: 2022-12-09_13:18:18.691415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:20.284027 run osmo-stp_10.42.42.5(pid=9440): stderr: | 20221209131818883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131818883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131818884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131818884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131818885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131818885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131818885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:20.422762 run osmo-stp_10.42.42.5(pid=9440): stdout: | (launched: 2022-12-09_13:18:18.691415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:20.555836 run osmo-stp_10.42.42.5(pid=9440): stderr: | 20221209131818883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131818883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131818884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131818884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131818885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131818885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131818885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:20.712846 run patchelf(pid=9443): Terminating (SIGINT) 13:18:20.893416 run patchelf(pid=9443): Terminated: ok {rc=0} 13:18:21.023806 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9440): Process ended prematurely: osmo-stp_10.42.42.5(pid=9440) [trial-2360↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9440)] [trial-2360↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 13:18:21.033555 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:18:21.062359 run osmo-hlr_10.42.42.2(pid=9437): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9437)] 13:18:21.113193 run osmo-hlr_10.42.42.2(pid=9437): stdout: | (launched: 2022-12-09_13:18:17.679451) 13:18:21.165723 run osmo-hlr_10.42.42.2(pid=9437): stderr: | 20221209131817879 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131817879 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131817879 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131817879 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131817879 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131817879 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131817891 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131817902 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131817902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131817902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:21.218983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9436): Terminating (SIGTERM) 13:18:21.261864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9439): Terminating (SIGTERM) 13:18:21.304804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9442): Terminating (SIGTERM) 13:18:21.347758 --- ParallelTerminationStrategy: PID 9436 died... 13:18:21.368055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9436): Terminated: ok {rc=0} 13:18:21.415334 --- ParallelTerminationStrategy: PID 9439 died... 13:18:21.434965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9439): Terminated: ok {rc=0} 13:18:21.482377 --- ParallelTerminationStrategy: PID 9442 died... 13:18:21.502262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9442): Terminated: ok {rc=0} 13:18:21.591444 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 13:18:22.901296 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:18:22.906437 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:18:22.939729 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:18:22.978117 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:18:23.064236 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:18:23.097251 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:18:23.135031 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:18:23.732022 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:18:23.781100 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:23.791997 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:18:23.844282 tst cs_paging_gprs_active.py: using LAC 21724 13:18:23.976914 tst cs_paging_gprs_active.py: using RAC 49 13:18:24.106619 tst cs_paging_gprs_active.py: using CellId 21724 13:18:24.233099 tst cs_paging_gprs_active.py: using BVCI 21725 13:18:24.352050 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:24.363554 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:24.374792 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:24.386254 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:24.397707 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:24.409264 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:24.420755 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:24.432145 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:24.443856 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:18:24.561649 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:18:24.681670 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:18:24.902971 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:25.233371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9447): Launched 13:18:25.518378 run iperf3-srv_10.42.42.10(pid=9448): Launched 13:18:25.643460 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:18:25.864730 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:26.194097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9449): Launched 13:18:26.478591 run iperf3-srv_10.42.42.10(pid=9450): Launched 13:18:26.601752 tst cs_paging_gprs_active.py:38: start network... 13:18:26.822513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:27.331539 run create_hlr_db(pid=9451): Launched 13:18:27.457334 bus /gobi_6: Setting Powered False 13:18:28.521546 run create_hlr_db(pid=9451): Terminated: ok {rc=0} 13:18:28.977529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9453): Launched 13:18:29.307004 run osmo-hlr_10.42.42.2(pid=9454): Launched 13:18:29.432515 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:30.001039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9456): Launched 13:18:30.329816 run osmo-stp_10.42.42.5(pid=9457): Launched 13:18:30.456758 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:18:31.044069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9459): Launched 13:18:31.182104 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:18:31.465576 run patchelf(pid=9460): Launched 13:18:31.651951 run osmo-stp_10.42.42.5(pid=9457): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9457)] 13:18:31.786020 run osmo-stp_10.42.42.5(pid=9457): stdout: | (launched: 2022-12-09_13:18:30.269876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:31.922291 run osmo-stp_10.42.42.5(pid=9457): stderr: | 20221209131830462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131830462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131830462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131830463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131830463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131830463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131830463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:32.057662 run osmo-stp_10.42.42.5(pid=9457): stdout: | (launched: 2022-12-09_13:18:30.269876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:32.187238 run osmo-stp_10.42.42.5(pid=9457): stderr: | 20221209131830462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131830462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131830462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131830463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131830463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131830463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131830463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:32.336604 run patchelf(pid=9460): Terminating (SIGINT) 13:18:32.508109 run patchelf(pid=9460): Terminated: ok {rc=0} 13:18:32.632064 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9457): Process ended prematurely: osmo-stp_10.42.42.5(pid=9457) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9457)] [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:18:32.641560 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:18:32.668632 run osmo-hlr_10.42.42.2(pid=9454): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9454)] 13:18:32.716510 run osmo-hlr_10.42.42.2(pid=9454): stdout: | (launched: 2022-12-09_13:18:29.245830) 13:18:32.765662 run osmo-hlr_10.42.42.2(pid=9454): stderr: | 20221209131829447 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131829447 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131829447 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131829447 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131829447 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131829447 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131829460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131829470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131829470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131829470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:32.815422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9447): Terminating (SIGTERM) 13:18:32.855368 run iperf3-srv_10.42.42.10(pid=9448): Terminating (SIGTERM) 13:18:32.895209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9449): Terminating (SIGTERM) 13:18:32.935361 run iperf3-srv_10.42.42.10(pid=9450): Terminating (SIGTERM) 13:18:32.975081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9453): Terminating (SIGTERM) 13:18:33.014780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9456): Terminating (SIGTERM) 13:18:33.054511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9459): Terminating (SIGTERM) 13:18:33.094615 --- ParallelTerminationStrategy: PID 9447 died... 13:18:33.113782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9447): Terminated: ok {rc=0} 13:18:33.157879 --- ParallelTerminationStrategy: PID 9448 died... 13:18:33.176263 run iperf3-srv_10.42.42.10(pid=9448): Terminated {rc=256} 13:18:33.220082 --- ParallelTerminationStrategy: PID 9449 died... 13:18:33.238600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9449): Terminated: ok {rc=0} 13:18:33.282650 --- ParallelTerminationStrategy: PID 9450 died... 13:18:33.301182 run iperf3-srv_10.42.42.10(pid=9450): Terminated {rc=256} 13:18:33.345194 --- ParallelTerminationStrategy: PID 9453 died... 13:18:33.363658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9453): Terminated: ok {rc=0} 13:18:33.407158 --- ParallelTerminationStrategy: PID 9456 died... 13:18:33.425708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9456): Terminated: ok {rc=0} 13:18:33.469442 --- ParallelTerminationStrategy: PID 9459 died... 13:18:33.487959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9459): Terminated: ok {rc=0} 13:18:33.571499 bus /gobi_0: Setting Powered False 13:18:34.666985 bus /gobi_0: Setting Powered False 13:18:35.781870 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:18:36.928594 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:36.940286 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:18:36.994813 tst iperf3.py: using LAC 21725 13:18:37.117393 tst iperf3.py: using RAC 50 13:18:37.248245 tst iperf3.py: using CellId 21725 13:18:37.376494 tst iperf3.py: using BVCI 21726 13:18:37.490507 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:37.501697 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:37.512406 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:37.523218 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:37.533942 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:37.544714 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:37.555725 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:37.566479 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:37.577430 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:18:37.694730 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:18:37.900274 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:38.207683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9461): Launched 13:18:38.474730 run iperf3-srv_10.42.42.10(pid=9462): Launched 13:18:38.591423 tst iperf3.py:8: start network... 13:18:38.796338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:39.272800 run create_hlr_db(pid=9463): Launched 13:18:39.397947 bus /gobi_6: Setting Powered False 13:18:40.458058 run create_hlr_db(pid=9463): Terminated: ok {rc=0} 13:18:40.884414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9465): Launched 13:18:41.193267 run osmo-hlr_10.42.42.2(pid=9466): Launched 13:18:41.310643 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:41.840481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9468): Launched 13:18:42.147600 run osmo-stp_10.42.42.5(pid=9469): Launched 13:18:42.265291 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:18:42.794392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9471): Launched 13:18:42.911455 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:18:43.170544 run patchelf(pid=9472): Launched 13:18:43.342030 run osmo-stp_10.42.42.5(pid=9469): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9469)] 13:18:43.472104 run osmo-stp_10.42.42.5(pid=9469): stdout: | (launched: 2022-12-09_13:18:42.090749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:43.603303 run osmo-stp_10.42.42.5(pid=9469): stderr: | 20221209131842262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131842262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131842263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131842263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131842263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131842263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131842264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:43.733980 run osmo-stp_10.42.42.5(pid=9469): stdout: | (launched: 2022-12-09_13:18:42.090749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:43.859328 run osmo-stp_10.42.42.5(pid=9469): stderr: | 20221209131842262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131842262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131842263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131842263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131842263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131842263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131842264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:44.007919 run patchelf(pid=9472): Terminating (SIGINT) 13:18:44.178642 run patchelf(pid=9472): Terminated: ok {rc=0} 13:18:44.301680 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9469): Process ended prematurely: osmo-stp_10.42.42.5(pid=9469) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9469)] [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 13:18:44.310984 tst iperf3.py:8: Test FAILED (7.4 sec) 13:18:44.338222 run osmo-hlr_10.42.42.2(pid=9466): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9466)] 13:18:44.385897 run osmo-hlr_10.42.42.2(pid=9466): stdout: | (launched: 2022-12-09_13:18:41.136567) 13:18:44.435328 run osmo-hlr_10.42.42.2(pid=9466): stderr: | 20221209131841315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131841315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131841315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131841315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131841315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131841315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131841330 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131841341 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131841341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131841341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:44.485352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9461): Terminating (SIGTERM) 13:18:44.525390 run iperf3-srv_10.42.42.10(pid=9462): Terminating (SIGTERM) 13:18:44.565360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9465): Terminating (SIGTERM) 13:18:44.605209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9468): Terminating (SIGTERM) 13:18:44.645154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9471): Terminating (SIGTERM) 13:18:44.685339 --- ParallelTerminationStrategy: PID 9461 died... 13:18:44.704431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9461): Terminated: ok {rc=0} 13:18:44.748340 --- ParallelTerminationStrategy: PID 9462 died... 13:18:44.766812 run iperf3-srv_10.42.42.10(pid=9462): Terminated {rc=256} 13:18:44.810763 --- ParallelTerminationStrategy: PID 9465 died... 13:18:44.829424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9465): Terminated: ok {rc=0} 13:18:44.873874 --- ParallelTerminationStrategy: PID 9468 died... 13:18:44.892645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9468): Terminated: ok {rc=0} 13:18:44.936748 --- ParallelTerminationStrategy: PID 9471 died... 13:18:44.955529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9471): Terminated: ok {rc=0} 13:18:45.040090 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:18:46.190186 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:46.203369 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:18:46.259779 tst iperf3m4.py: using LAC 21726 13:18:46.395808 tst iperf3m4.py: using RAC 51 13:18:46.519896 tst iperf3m4.py: using CellId 21726 13:18:46.641557 tst iperf3m4.py: using BVCI 21727 13:18:46.781816 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:46.794634 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:46.807119 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:46.821471 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:46.834868 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:46.849897 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:46.862816 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:46.876206 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:18:46.890908 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:18:47.034057 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:18:47.166844 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:18:47.291742 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:18:47.412231 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:18:47.620930 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:47.930089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9473): Launched 13:18:48.199358 run iperf3-srv_10.42.42.10(pid=9474): Launched 13:18:48.314862 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:18:48.520571 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:48.829342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9475): Launched 13:18:49.096840 run iperf3-srv_10.42.42.10(pid=9476): Launched 13:18:49.211856 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:18:49.417457 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:49.726313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9477): Launched 13:18:49.994965 run iperf3-srv_10.42.42.10(pid=9478): Launched 13:18:50.110244 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:18:50.315248 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:50.622887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9479): Launched 13:18:50.889961 run iperf3-srv_10.42.42.10(pid=9480): Launched 13:18:51.007152 tst iperf3m4.py:8: start network... 13:18:51.213381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:51.689674 run create_hlr_db(pid=9481): Launched 13:18:51.814748 bus /gobi_6: Setting Powered False 13:18:52.876034 run create_hlr_db(pid=9481): Terminated: ok {rc=0} 13:18:53.324127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9483): Launched 13:18:53.653653 run osmo-hlr_10.42.42.2(pid=9484): Launched 13:18:53.781246 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:54.350233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9486): Launched 13:18:54.677762 run osmo-stp_10.42.42.5(pid=9487): Launched 13:18:54.803686 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:18:55.370089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9489): Launched 13:18:55.496301 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:18:55.773653 run patchelf(pid=9490): Launched 13:18:55.955778 run osmo-stp_10.42.42.5(pid=9487): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9487)] 13:18:56.094682 run osmo-stp_10.42.42.5(pid=9487): stdout: | (launched: 2022-12-09_13:18:54.617717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:56.234567 run osmo-stp_10.42.42.5(pid=9487): stderr: | 20221209131854807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131854807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131854807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131854807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131854808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131854808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131854808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:56.374401 run osmo-stp_10.42.42.5(pid=9487): stdout: | (launched: 2022-12-09_13:18:54.617717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:56.508890 run osmo-stp_10.42.42.5(pid=9487): stderr: | 20221209131854807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131854807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131854807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131854807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131854808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131854808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131854808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:56.668290 run patchelf(pid=9490): Terminating (SIGINT) 13:18:56.851069 run patchelf(pid=9490): Terminated: ok {rc=0} 13:18:56.983040 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9487): Process ended prematurely: osmo-stp_10.42.42.5(pid=9487) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9487)] [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 13:18:56.993379 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:18:57.022875 run osmo-hlr_10.42.42.2(pid=9484): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9484)] 13:18:57.072929 run osmo-hlr_10.42.42.2(pid=9484): stdout: | (launched: 2022-12-09_13:18:53.593648) 13:18:57.125089 run osmo-hlr_10.42.42.2(pid=9484): stderr: | 20221209131853789 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131853789 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131853789 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131853789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131853789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131853789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131853801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131853810 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131853810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131853811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:57.177665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9473): Terminating (SIGTERM) 13:18:57.219947 run iperf3-srv_10.42.42.10(pid=9474): Terminating (SIGTERM) 13:18:57.262253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9475): Terminating (SIGTERM) 13:18:57.304527 run iperf3-srv_10.42.42.10(pid=9476): Terminating (SIGTERM) 13:18:57.346817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9477): Terminating (SIGTERM) 13:18:57.389142 run iperf3-srv_10.42.42.10(pid=9478): Terminating (SIGTERM) 13:18:57.431206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9479): Terminating (SIGTERM) 13:18:57.473352 run iperf3-srv_10.42.42.10(pid=9480): Terminating (SIGTERM) 13:18:57.515925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9483): Terminating (SIGTERM) 13:18:57.558401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9486): Terminating (SIGTERM) 13:18:57.600559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9489): Terminating (SIGTERM) 13:18:57.643325 --- ParallelTerminationStrategy: PID 9473 died... 13:18:57.663571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9473): Terminated: ok {rc=0} 13:18:57.710904 --- ParallelTerminationStrategy: PID 9474 died... 13:18:57.730602 run iperf3-srv_10.42.42.10(pid=9474): Terminated {rc=256} 13:18:57.777419 --- ParallelTerminationStrategy: PID 9475 died... 13:18:57.797054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9475): Terminated: ok {rc=0} 13:18:57.843838 --- ParallelTerminationStrategy: PID 9476 died... 13:18:57.863323 run iperf3-srv_10.42.42.10(pid=9476): Terminated {rc=256} 13:18:57.909799 --- ParallelTerminationStrategy: PID 9477 died... 13:18:57.929466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9477): Terminated: ok {rc=0} 13:18:57.976409 --- ParallelTerminationStrategy: PID 9478 died... 13:18:57.996049 run iperf3-srv_10.42.42.10(pid=9478): Terminated {rc=256} 13:18:58.042684 --- ParallelTerminationStrategy: PID 9479 died... 13:18:58.062177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9479): Terminated: ok {rc=0} 13:18:58.108825 --- ParallelTerminationStrategy: PID 9480 died... 13:18:58.128829 run iperf3-srv_10.42.42.10(pid=9480): Terminated {rc=256} 13:18:58.175204 --- ParallelTerminationStrategy: PID 9483 died... 13:18:58.194788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9483): Terminated: ok {rc=0} 13:18:58.241378 --- ParallelTerminationStrategy: PID 9486 died... 13:18:58.260754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9486): Terminated: ok {rc=0} 13:18:58.307196 --- ParallelTerminationStrategy: PID 9489 died... 13:18:58.327650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9489): Terminated: ok {rc=0} 13:18:58.416534 bus /gobi_4: Setting Powered False 13:18:59.517053 bus /gobi_4: Setting Powered False 13:19:00.633526 bus /gobi_1: Setting Powered False 13:19:01.732487 bus /gobi_1: Setting Powered False 13:19:02.851886 bus /gobi_0: Setting Powered False 13:19:03.950660 bus /gobi_0: Setting Powered False 13:19:05.066585 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 13:19:06.170466 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:19:06.182274 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:19:06.236785 tst ping.py: using LAC 21727 13:19:06.354146 tst ping.py: using RAC 52 13:19:06.470613 tst ping.py: using CellId 21727 13:19:06.589117 tst ping.py: using BVCI 21728 13:19:06.701097 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:19:06.712180 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:19:06.722974 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:19:06.733853 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:19:06.744580 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:19:06.755441 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:19:06.766421 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:19:06.777175 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:19:06.895931 tst ping.py:19: start network... 13:19:07.114179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:07.612672 run create_hlr_db(pid=9491): Launched 13:19:07.735995 bus /gobi_6: Setting Powered False 13:19:08.799813 run create_hlr_db(pid=9491): Terminated: ok {rc=0} 13:19:09.232508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9493): Launched 13:19:09.535278 run osmo-hlr_10.42.42.2(pid=9494): Launched 13:19:09.651949 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:10.180026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9496): Launched 13:19:10.481752 run osmo-stp_10.42.42.5(pid=9497): Launched 13:19:10.596504 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:19:11.116118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9499): Launched 13:19:11.231503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:19:11.486245 run patchelf(pid=9500): Launched 13:19:11.656604 run osmo-stp_10.42.42.5(pid=9497): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9497)] 13:19:11.785254 run osmo-stp_10.42.42.5(pid=9497): stdout: | (launched: 2022-12-09_13:19:10.425938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:11.914572 run osmo-stp_10.42.42.5(pid=9497): stderr: | 20221209131910594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131910594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131910595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131910595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131910595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131910595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131910596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:12.044690 run osmo-stp_10.42.42.5(pid=9497): stdout: | (launched: 2022-12-09_13:19:10.425938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:12.168301 run osmo-stp_10.42.42.5(pid=9497): stderr: | 20221209131910594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131910594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131910595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131910595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131910595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131910595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131910596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:12.314860 run patchelf(pid=9500): Terminating (SIGINT) 13:19:12.483824 run patchelf(pid=9500): Terminated: ok {rc=0} 13:19:12.605650 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9497): Process ended prematurely: osmo-stp_10.42.42.5(pid=9497) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9497)] [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 13:19:12.614506 tst ping.py:22: Test FAILED (6.4 sec) 13:19:12.641292 run osmo-hlr_10.42.42.2(pid=9494): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9494)] 13:19:12.689185 run osmo-hlr_10.42.42.2(pid=9494): stdout: | (launched: 2022-12-09_13:19:09.479516) 13:19:12.738508 run osmo-hlr_10.42.42.2(pid=9494): stderr: | 20221209131909655 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131909655 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131909655 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131909655 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131909655 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131909655 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131909667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131909676 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131909676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131909677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:12.788215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9493): Terminating (SIGTERM) 13:19:12.827953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9496): Terminating (SIGTERM) 13:19:12.867523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9499): Terminating (SIGTERM) 13:19:12.907320 --- ParallelTerminationStrategy: PID 9493 died... 13:19:12.925898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9493): Terminated: ok {rc=0} 13:19:12.969964 --- ParallelTerminationStrategy: PID 9496 died... 13:19:12.988458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9496): Terminated: ok {rc=0} 13:19:13.032712 --- ParallelTerminationStrategy: PID 9499 died... 13:19:13.051632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9499): Terminated: ok {rc=0} 13:19:13.136024 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:19:14.222396 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:19:14.235212 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:19:14.289441 tst ping_idle_ping.py: using LAC 21728 13:19:14.416799 tst ping_idle_ping.py: using RAC 53 13:19:14.541764 tst ping_idle_ping.py: using CellId 21728 13:19:14.669745 tst ping_idle_ping.py: using BVCI 21729 13:19:14.788600 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:19:14.800229 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:19:14.811596 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:19:14.823185 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:19:14.834794 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:19:14.846410 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:19:14.858238 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:19:14.869828 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:19:14.991417 tst ping_idle_ping.py:24: start network... 13:19:15.209082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:15.711336 run create_hlr_db(pid=9501): Launched 13:19:15.838962 bus /gobi_6: Setting Powered False 13:19:16.902594 run create_hlr_db(pid=9501): Terminated: ok {rc=0} 13:19:17.376885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9503): Launched 13:19:17.681450 run osmo-hlr_10.42.42.2(pid=9504): Launched 13:19:17.797447 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:18.323504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9506): Launched 13:19:18.626682 run osmo-stp_10.42.42.5(pid=9507): Launched 13:19:18.741665 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:19:19.264877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9509): Launched 13:19:19.381303 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:19:19.637374 run patchelf(pid=9510): Launched 13:19:19.807121 run osmo-stp_10.42.42.5(pid=9507): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9507)] 13:19:19.936019 run osmo-stp_10.42.42.5(pid=9507): stdout: | (launched: 2022-12-09_13:19:18.570766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:20.066414 run osmo-stp_10.42.42.5(pid=9507): stderr: | 20221209131918741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131918742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131918742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131918742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131918743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131918743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131918743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:20.196544 run osmo-stp_10.42.42.5(pid=9507): stdout: | (launched: 2022-12-09_13:19:18.570766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:20.320812 run osmo-stp_10.42.42.5(pid=9507): stderr: | 20221209131918741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131918742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131918742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131918742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131918743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131918743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131918743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:20.468164 run patchelf(pid=9510): Terminating (SIGINT) 13:19:20.637895 run patchelf(pid=9510): Terminated: ok {rc=0} 13:19:20.760035 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9507): Process ended prematurely: osmo-stp_10.42.42.5(pid=9507) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9507)] [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 13:19:20.768865 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:19:20.795555 run osmo-hlr_10.42.42.2(pid=9504): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9504)] 13:19:20.843557 run osmo-hlr_10.42.42.2(pid=9504): stdout: | (launched: 2022-12-09_13:19:17.625611) 13:19:20.892649 run osmo-hlr_10.42.42.2(pid=9504): stderr: | 20221209131917800 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131917800 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131917800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131917800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131917800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131917801 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131917811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131917819 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131917819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131917819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:20.942261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9503): Terminating (SIGTERM) 13:19:20.982201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9506): Terminating (SIGTERM) 13:19:21.022065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9509): Terminating (SIGTERM) 13:19:21.062226 --- ParallelTerminationStrategy: PID 9503 died... 13:19:21.081383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9503): Terminated: ok {rc=0} 13:19:21.125613 --- ParallelTerminationStrategy: PID 9506 died... 13:19:21.144271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9506): Terminated: ok {rc=0} 13:19:21.189282 --- ParallelTerminationStrategy: PID 9509 died... 13:19:21.208114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9509): Terminated: ok {rc=0} 13:19:21.292059 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:19:22.610630 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:19:22.617297 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:19:22.654483 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:19:22.694992 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:19:22.784378 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:19:22.819800 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:19:22.860116 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:19:23.456669 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:19:23.510269 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:23.521937 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:19:23.594658 tst cs_paging_gprs_active.py: using LAC 21729 13:19:23.721965 tst cs_paging_gprs_active.py: using RAC 54 13:19:23.852031 tst cs_paging_gprs_active.py: using CellId 21729 13:19:23.979879 tst cs_paging_gprs_active.py: using BVCI 21730 13:19:24.099265 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:24.110775 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:24.122088 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:24.133760 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:24.145355 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:24.156940 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:24.168702 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:24.180286 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:24.192153 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:19:24.312458 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:19:24.432438 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:19:24.654941 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:19:24.983962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9514): Launched 13:19:25.268760 run iperf3-srv_10.42.42.10(pid=9515): Launched 13:19:25.391616 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:19:25.612942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:19:25.942337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9516): Launched 13:19:26.227726 run iperf3-srv_10.42.42.10(pid=9517): Launched 13:19:26.351072 tst cs_paging_gprs_active.py:38: start network... 13:19:26.571891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:27.080825 run create_hlr_db(pid=9518): Launched 13:19:27.205209 bus /gobi_6: Setting Powered False 13:19:28.270322 run create_hlr_db(pid=9518): Terminated: ok {rc=0} 13:19:28.709943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9520): Launched 13:19:29.017510 run osmo-hlr_10.42.42.2(pid=9521): Launched 13:19:29.136237 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:29.666334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9523): Launched 13:19:29.974925 run osmo-stp_10.42.42.5(pid=9524): Launched 13:19:30.092504 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:19:30.623433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9526): Launched 13:19:30.741152 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:19:31.020496 run patchelf(pid=9527): Launched 13:19:31.214905 run osmo-stp_10.42.42.5(pid=9524): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9524)] 13:19:31.346244 run osmo-stp_10.42.42.5(pid=9524): stdout: | (launched: 2022-12-09_13:19:29.918334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:31.479674 run osmo-stp_10.42.42.5(pid=9524): stderr: | 20221209131930087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131930087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131930088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131930088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131930089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131930089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131930089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:31.613815 run osmo-stp_10.42.42.5(pid=9524): stdout: | (launched: 2022-12-09_13:19:29.918334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:31.741313 run osmo-stp_10.42.42.5(pid=9524): stderr: | 20221209131930087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131930087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131930088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131930088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131930089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131930089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131930089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:31.900151 run patchelf(pid=9527): Terminating (SIGINT) 13:19:32.104303 run patchelf(pid=9527): Terminated: ok {rc=0} 13:19:32.231881 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9524): Process ended prematurely: osmo-stp_10.42.42.5(pid=9524) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9524)] [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:19:32.242708 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:19:32.272390 run osmo-hlr_10.42.42.2(pid=9521): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9521)] 13:19:32.321046 run osmo-hlr_10.42.42.2(pid=9521): stdout: | (launched: 2022-12-09_13:19:28.960275) 13:19:32.370989 run osmo-hlr_10.42.42.2(pid=9521): stderr: | 20221209131929138 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131929138 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131929138 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131929139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131929139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131929139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131929151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131929159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131929160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131929160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:32.421579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9514): Terminating (SIGTERM) 13:19:32.461721 run iperf3-srv_10.42.42.10(pid=9515): Terminating (SIGTERM) 13:19:32.501758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9516): Terminating (SIGTERM) 13:19:32.541798 run iperf3-srv_10.42.42.10(pid=9517): Terminating (SIGTERM) 13:19:32.581771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9520): Terminating (SIGTERM) 13:19:32.621737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9523): Terminating (SIGTERM) 13:19:32.661873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9526): Terminating (SIGTERM) 13:19:32.702234 --- ParallelTerminationStrategy: PID 9514 died... 13:19:32.721274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9514): Terminated: ok {rc=0} 13:19:32.765554 --- ParallelTerminationStrategy: PID 9515 died... 13:19:32.784251 run iperf3-srv_10.42.42.10(pid=9515): Terminated {rc=256} 13:19:32.828600 --- ParallelTerminationStrategy: PID 9516 died... 13:19:32.847295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9516): Terminated: ok {rc=0} 13:19:32.891251 --- ParallelTerminationStrategy: PID 9517 died... 13:19:32.909916 run iperf3-srv_10.42.42.10(pid=9517): Terminated {rc=256} 13:19:32.953825 --- ParallelTerminationStrategy: PID 9520 died... 13:19:32.972527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9520): Terminated: ok {rc=0} 13:19:33.016397 --- ParallelTerminationStrategy: PID 9523 died... 13:19:33.035056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9523): Terminated: ok {rc=0} 13:19:33.079151 --- ParallelTerminationStrategy: PID 9526 died... 13:19:33.097938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9526): Terminated: ok {rc=0} 13:19:33.181891 bus /gobi_0: Setting Powered False 13:19:34.277299 bus /gobi_0: Setting Powered False 13:19:35.391791 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:19:36.539888 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:36.551602 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:19:36.624161 tst iperf3.py: using LAC 21730 13:19:36.745433 tst iperf3.py: using RAC 55 13:19:36.867462 tst iperf3.py: using CellId 21730 13:19:36.989774 tst iperf3.py: using BVCI 21731 13:19:37.110582 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:37.122394 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:37.133846 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:37.145602 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:37.157281 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:37.168914 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:37.180832 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:37.192348 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:37.204077 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:19:37.323712 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:19:37.545058 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:19:37.873944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9528): Launched 13:19:38.159233 run iperf3-srv_10.42.42.10(pid=9529): Launched 13:19:38.283632 tst iperf3.py:8: start network... 13:19:38.503853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:39.011723 run create_hlr_db(pid=9530): Launched 13:19:39.136930 bus /gobi_6: Setting Powered False 13:19:40.201434 run create_hlr_db(pid=9530): Terminated: ok {rc=0} 13:19:40.638191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9532): Launched 13:19:40.947115 run osmo-hlr_10.42.42.2(pid=9533): Launched 13:19:41.064539 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:41.594370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9535): Launched 13:19:41.901693 run osmo-stp_10.42.42.5(pid=9536): Launched 13:19:42.018791 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:19:42.548779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9538): Launched 13:19:42.666178 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:19:42.925571 run patchelf(pid=9539): Launched 13:19:43.096706 run osmo-stp_10.42.42.5(pid=9536): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9536)] 13:19:43.227041 run osmo-stp_10.42.42.5(pid=9536): stdout: | (launched: 2022-12-09_13:19:41.844386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:43.359072 run osmo-stp_10.42.42.5(pid=9536): stderr: | 20221209131942015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131942015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131942015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131942016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131942016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131942016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131942016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:43.490575 run osmo-stp_10.42.42.5(pid=9536): stdout: | (launched: 2022-12-09_13:19:41.844386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:43.617078 run osmo-stp_10.42.42.5(pid=9536): stderr: | 20221209131942015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131942015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131942015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131942016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131942016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131942016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131942016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:43.766427 run patchelf(pid=9539): Terminating (SIGINT) 13:19:43.939197 run patchelf(pid=9539): Terminated: ok {rc=0} 13:19:44.062763 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9536): Process ended prematurely: osmo-stp_10.42.42.5(pid=9536) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9536)] [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 13:19:44.072534 tst iperf3.py:8: Test FAILED (7.6 sec) 13:19:44.099579 run osmo-hlr_10.42.42.2(pid=9533): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9533)] 13:19:44.147587 run osmo-hlr_10.42.42.2(pid=9533): stdout: | (launched: 2022-12-09_13:19:40.890250) 13:19:44.196810 run osmo-hlr_10.42.42.2(pid=9533): stderr: | 20221209131941068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131941068 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131941068 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131941069 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131941069 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131941069 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131941081 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131941090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131941090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131941090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:44.246557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9528): Terminating (SIGTERM) 13:19:44.286327 run iperf3-srv_10.42.42.10(pid=9529): Terminating (SIGTERM) 13:19:44.325963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9532): Terminating (SIGTERM) 13:19:44.365617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9535): Terminating (SIGTERM) 13:19:44.405143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9538): Terminating (SIGTERM) 13:19:44.445022 --- ParallelTerminationStrategy: PID 9528 died... 13:19:44.464038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9528): Terminated: ok {rc=0} 13:19:44.507858 --- ParallelTerminationStrategy: PID 9529 died... 13:19:44.526306 run iperf3-srv_10.42.42.10(pid=9529): Terminated {rc=256} 13:19:44.569886 --- ParallelTerminationStrategy: PID 9532 died... 13:19:44.588451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9532): Terminated: ok {rc=0} 13:19:44.632393 --- ParallelTerminationStrategy: PID 9535 died... 13:19:44.651070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9535): Terminated: ok {rc=0} 13:19:44.694656 --- ParallelTerminationStrategy: PID 9538 died... 13:19:44.713272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9538): Terminated: ok {rc=0} 13:19:44.797142 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:19:45.969925 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:45.983583 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:19:46.074742 tst iperf3m4.py: using LAC 21731 13:19:46.198360 tst iperf3m4.py: using RAC 56 13:19:46.341782 tst iperf3m4.py: using CellId 21731 13:19:46.499318 tst iperf3m4.py: using BVCI 21732 13:19:46.614355 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:46.626101 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:46.637580 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:46.648930 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:46.660277 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:46.671921 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:46.683428 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:46.694866 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:19:46.708135 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:19:46.842737 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:19:47.005571 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:19:47.127016 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:19:47.269578 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:19:47.484440 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:19:47.795594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9540): Launched 13:19:48.065634 run iperf3-srv_10.42.42.10(pid=9541): Launched 13:19:48.181244 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:19:48.386958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:19:48.696443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9542): Launched 13:19:48.964079 run iperf3-srv_10.42.42.10(pid=9543): Launched 13:19:49.082499 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:19:49.288583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:19:49.597310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9544): Launched 13:19:49.866553 run iperf3-srv_10.42.42.10(pid=9545): Launched 13:19:49.984638 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:19:50.189990 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:19:50.498124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9546): Launched 13:19:50.767380 run iperf3-srv_10.42.42.10(pid=9547): Launched 13:19:50.882686 tst iperf3m4.py:8: start network... 13:19:51.087722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:51.563106 run create_hlr_db(pid=9548): Launched 13:19:51.687984 bus /gobi_6: Setting Powered False 13:19:52.749527 run create_hlr_db(pid=9548): Terminated: ok {rc=0} 13:19:53.177645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9550): Launched 13:19:53.485472 run osmo-hlr_10.42.42.2(pid=9551): Launched 13:19:53.602959 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:54.132418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9553): Launched 13:19:54.439407 run osmo-stp_10.42.42.5(pid=9554): Launched 13:19:54.556330 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:19:55.086609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9556): Launched 13:19:55.203616 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:19:55.463576 run patchelf(pid=9557): Launched 13:19:55.634076 run osmo-stp_10.42.42.5(pid=9554): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9554)] 13:19:55.764233 run osmo-stp_10.42.42.5(pid=9554): stdout: | (launched: 2022-12-09_13:19:54.382862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:55.895376 run osmo-stp_10.42.42.5(pid=9554): stderr: | 20221209131954550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131954550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131954550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131954551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131954551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131954551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131954551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:56.027223 run osmo-stp_10.42.42.5(pid=9554): stdout: | (launched: 2022-12-09_13:19:54.382862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:56.153073 run osmo-stp_10.42.42.5(pid=9554): stderr: | 20221209131954550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209131954550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209131954550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209131954551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209131954551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209131954551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209131954551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:56.302151 run patchelf(pid=9557): Terminating (SIGINT) 13:19:56.473189 run patchelf(pid=9557): Terminated: ok {rc=0} 13:19:56.596534 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9554): Process ended prematurely: osmo-stp_10.42.42.5(pid=9554) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9554)] [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:19:56.606098 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:19:56.633356 run osmo-hlr_10.42.42.2(pid=9551): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9551)] 13:19:56.680561 run osmo-hlr_10.42.42.2(pid=9551): stdout: | (launched: 2022-12-09_13:19:53.428594) 13:19:56.729722 run osmo-hlr_10.42.42.2(pid=9551): stderr: | 20221209131953603 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209131953603 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209131953603 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209131953603 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209131953603 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209131953603 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209131953619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209131953629 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209131953629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209131953629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:56.779401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9540): Terminating (SIGTERM) 13:19:56.818979 run iperf3-srv_10.42.42.10(pid=9541): Terminating (SIGTERM) 13:19:56.858524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9542): Terminating (SIGTERM) 13:19:56.898167 run iperf3-srv_10.42.42.10(pid=9543): Terminating (SIGTERM) 13:19:56.937656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9544): Terminating (SIGTERM) 13:19:56.977221 run iperf3-srv_10.42.42.10(pid=9545): Terminating (SIGTERM) 13:19:57.016639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9546): Terminating (SIGTERM) 13:19:57.056004 run iperf3-srv_10.42.42.10(pid=9547): Terminating (SIGTERM) 13:19:57.095481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9550): Terminating (SIGTERM) 13:19:57.135157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9553): Terminating (SIGTERM) 13:19:57.174612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9556): Terminating (SIGTERM) 13:19:57.214369 --- ParallelTerminationStrategy: PID 9540 died... 13:19:57.233278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9540): Terminated: ok {rc=0} 13:19:57.277145 --- ParallelTerminationStrategy: PID 9541 died... 13:19:57.295754 run iperf3-srv_10.42.42.10(pid=9541): Terminated {rc=256} 13:19:57.339339 --- ParallelTerminationStrategy: PID 9542 died... 13:19:57.357918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9542): Terminated: ok {rc=0} 13:19:57.402004 --- ParallelTerminationStrategy: PID 9543 died... 13:19:57.420503 run iperf3-srv_10.42.42.10(pid=9543): Terminated {rc=256} 13:19:57.463839 --- ParallelTerminationStrategy: PID 9544 died... 13:19:57.482264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9544): Terminated: ok {rc=0} 13:19:57.525915 --- ParallelTerminationStrategy: PID 9545 died... 13:19:57.544336 run iperf3-srv_10.42.42.10(pid=9545): Terminated {rc=256} 13:19:57.587800 --- ParallelTerminationStrategy: PID 9546 died... 13:19:57.606403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9546): Terminated: ok {rc=0} 13:19:57.649988 --- ParallelTerminationStrategy: PID 9547 died... 13:19:57.668592 run iperf3-srv_10.42.42.10(pid=9547): Terminated {rc=256} 13:19:57.712117 --- ParallelTerminationStrategy: PID 9550 died... 13:19:57.730753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9550): Terminated: ok {rc=0} 13:19:57.775293 --- ParallelTerminationStrategy: PID 9553 died... 13:19:57.793975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9553): Terminated: ok {rc=0} 13:19:57.837599 --- ParallelTerminationStrategy: PID 9556 died... 13:19:57.856167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9556): Terminated: ok {rc=0} 13:19:57.940238 bus /gobi_4: Setting Powered False 13:19:59.038478 bus /gobi_4: Setting Powered False 13:20:00.156851 bus /gobi_1: Setting Powered False 13:20:01.255974 bus /gobi_1: Setting Powered False 13:20:02.372322 bus /gobi_0: Setting Powered False 13:20:03.470909 bus /gobi_0: Setting Powered False 13:20:04.591925 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:20:05.698827 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:20:05.711439 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:20:05.785685 tst ping.py: using LAC 21732 13:20:05.913401 tst ping.py: using RAC 57 13:20:06.041419 tst ping.py: using CellId 21732 13:20:06.169026 tst ping.py: using BVCI 21733 13:20:06.287209 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:20:06.298947 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:20:06.310503 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:20:06.322085 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:20:06.333556 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:20:06.345168 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:20:06.356921 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:20:06.368459 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:20:06.485396 tst ping.py:19: start network... 13:20:06.686875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:07.153097 run create_hlr_db(pid=9561): Launched 13:20:07.276555 bus /gobi_6: Setting Powered False 13:20:08.336188 run create_hlr_db(pid=9561): Terminated: ok {rc=0} 13:20:08.775402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9563): Launched 13:20:09.098159 run osmo-hlr_10.42.42.2(pid=9564): Launched 13:20:09.222285 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:09.781102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9566): Launched 13:20:10.104090 run osmo-stp_10.42.42.5(pid=9567): Launched 13:20:10.226859 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:20:10.782996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9569): Launched 13:20:10.906491 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:20:11.179175 run patchelf(pid=9570): Launched 13:20:11.359856 run osmo-stp_10.42.42.5(pid=9567): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9567)] 13:20:11.496741 run osmo-stp_10.42.42.5(pid=9567): stdout: | (launched: 2022-12-09_13:20:10.044542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:11.634813 run osmo-stp_10.42.42.5(pid=9567): stderr: | 20221209132010237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132010237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132010238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132010238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132010238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132010238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132010239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:11.773024 run osmo-stp_10.42.42.5(pid=9567): stdout: | (launched: 2022-12-09_13:20:10.044542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:11.905237 run osmo-stp_10.42.42.5(pid=9567): stderr: | 20221209132010237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132010237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132010238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132010238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132010238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132010238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132010239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:12.062429 run patchelf(pid=9570): Terminating (SIGINT) 13:20:12.242388 run patchelf(pid=9570): Terminated: ok {rc=0} 13:20:12.371970 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9567): Process ended prematurely: osmo-stp_10.42.42.5(pid=9567) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9567)] [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 13:20:12.381669 tst ping.py:22: Test FAILED (6.7 sec) 13:20:12.410370 run osmo-hlr_10.42.42.2(pid=9564): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9564)] 13:20:12.461887 run osmo-hlr_10.42.42.2(pid=9564): stdout: | (launched: 2022-12-09_13:20:09.039335) 13:20:12.514405 run osmo-hlr_10.42.42.2(pid=9564): stderr: | 20221209132009236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132009236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132009236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132009236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132009236 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132009236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132009251 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132009262 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132009262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132009262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:12.567451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9563): Terminating (SIGTERM) 13:20:12.610009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9566): Terminating (SIGTERM) 13:20:12.652617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9569): Terminating (SIGTERM) 13:20:12.695658 --- ParallelTerminationStrategy: PID 9563 died... 13:20:12.715916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9563): Terminated: ok {rc=0} 13:20:12.763304 --- ParallelTerminationStrategy: PID 9566 died... 13:20:12.783164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9566): Terminated: ok {rc=0} 13:20:12.830288 --- ParallelTerminationStrategy: PID 9569 died... 13:20:12.850102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9569): Terminated: ok {rc=0} 13:20:12.938754 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:20:14.027257 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:20:14.039666 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:20:14.113968 tst ping_idle_ping.py: using LAC 21733 13:20:14.236555 tst ping_idle_ping.py: using RAC 58 13:20:14.357493 tst ping_idle_ping.py: using CellId 21733 13:20:14.478277 tst ping_idle_ping.py: using BVCI 21734 13:20:14.589678 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:20:14.600700 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:20:14.611762 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:20:14.622638 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:20:14.633541 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:20:14.644435 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:20:14.655425 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:20:14.666348 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:20:14.781800 tst ping_idle_ping.py:24: start network... 13:20:14.986487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:15.463505 run create_hlr_db(pid=9571): Launched 13:20:15.586921 bus /gobi_6: Setting Powered False 13:20:16.662071 run create_hlr_db(pid=9571): Terminated: ok {rc=0} 13:20:17.124300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9573): Launched 13:20:17.451161 run osmo-hlr_10.42.42.2(pid=9574): Launched 13:20:17.577087 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:18.135154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9576): Launched 13:20:18.458054 run osmo-stp_10.42.42.5(pid=9577): Launched 13:20:18.580593 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:20:19.135339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9579): Launched 13:20:19.259682 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:20:19.531776 run patchelf(pid=9580): Launched 13:20:19.710873 run osmo-stp_10.42.42.5(pid=9577): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9577)] 13:20:19.847593 run osmo-stp_10.42.42.5(pid=9577): stdout: | (launched: 2022-12-09_13:20:18.398841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:19.985957 run osmo-stp_10.42.42.5(pid=9577): stderr: | 20221209132018590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132018590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132018590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132018591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132018591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132018591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132018591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:20.124617 run osmo-stp_10.42.42.5(pid=9577): stdout: | (launched: 2022-12-09_13:20:18.398841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:20.257208 run osmo-stp_10.42.42.5(pid=9577): stderr: | 20221209132018590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132018590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132018590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132018591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132018591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132018591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132018591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:20.413834 run patchelf(pid=9580): Terminating (SIGINT) 13:20:20.593609 run patchelf(pid=9580): Terminated: ok {rc=0} 13:20:20.723270 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9577): Process ended prematurely: osmo-stp_10.42.42.5(pid=9577) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9577)] [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:20:20.732874 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:20:20.761252 run osmo-hlr_10.42.42.2(pid=9574): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9574)] 13:20:20.811024 run osmo-hlr_10.42.42.2(pid=9574): stdout: | (launched: 2022-12-09_13:20:17.392264) 13:20:20.862929 run osmo-hlr_10.42.42.2(pid=9574): stderr: | 20221209132017587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132017587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132017587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132017587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132017588 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132017588 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132017600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132017610 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132017610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132017610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:20.915111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9573): Terminating (SIGTERM) 13:20:20.956816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9576): Terminating (SIGTERM) 13:20:20.999249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9579): Terminating (SIGTERM) 13:20:21.041302 --- ParallelTerminationStrategy: PID 9573 died... 13:20:21.061147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9573): Terminated: ok {rc=0} 13:20:21.107437 --- ParallelTerminationStrategy: PID 9576 died... 13:20:21.126806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9576): Terminated: ok {rc=0} 13:20:21.173179 --- ParallelTerminationStrategy: PID 9579 died... 13:20:21.192525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9579): Terminated: ok {rc=0} 13:20:21.279427 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:20:22.586769 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:20:22.592885 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:20:22.626501 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:20:22.665339 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:20:22.752348 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:20:22.786289 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:20:22.824883 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:20:23.425629 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:20:23.478886 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:23.490643 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:20:23.563615 tst cs_paging_gprs_active.py: using LAC 21734 13:20:23.692456 tst cs_paging_gprs_active.py: using RAC 59 13:20:23.822849 tst cs_paging_gprs_active.py: using CellId 21734 13:20:23.950904 tst cs_paging_gprs_active.py: using BVCI 21735 13:20:24.070872 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:24.082547 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:24.093967 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:24.105507 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:24.116886 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:24.128503 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:24.140488 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:24.152384 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:24.164556 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:20:24.283632 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:20:24.400273 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:20:24.608507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:20:24.918746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9585): Launched 13:20:25.187329 run iperf3-srv_10.42.42.10(pid=9586): Launched 13:20:25.302643 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:20:25.509064 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:20:25.818585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9587): Launched 13:20:26.086956 run iperf3-srv_10.42.42.10(pid=9588): Launched 13:20:26.202734 tst cs_paging_gprs_active.py:38: start network... 13:20:26.410179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:26.888134 run create_hlr_db(pid=9589): Launched 13:20:27.014791 bus /gobi_6: Setting Powered False 13:20:28.075729 run create_hlr_db(pid=9589): Terminated: ok {rc=0} 13:20:28.522628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9591): Launched 13:20:28.851822 run osmo-hlr_10.42.42.2(pid=9592): Launched 13:20:28.977467 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:29.545683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9594): Launched 13:20:29.872049 run osmo-stp_10.42.42.5(pid=9595): Launched 13:20:29.997055 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:20:30.563045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9597): Launched 13:20:30.688548 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:20:30.991483 run patchelf(pid=9598): Launched 13:20:31.189212 run osmo-stp_10.42.42.5(pid=9595): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9595)] 13:20:31.332072 run osmo-stp_10.42.42.5(pid=9595): stdout: | (launched: 2022-12-09_13:20:29.812643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:31.476410 run osmo-stp_10.42.42.5(pid=9595): stderr: | 20221209132030002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132030002 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132030002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132030003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132030003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132030003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132030003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:31.621104 run osmo-stp_10.42.42.5(pid=9595): stdout: | (launched: 2022-12-09_13:20:29.812643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:31.759805 run osmo-stp_10.42.42.5(pid=9595): stderr: | 20221209132030002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132030002 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132030002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132030003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132030003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132030003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132030003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:31.923904 run patchelf(pid=9598): Terminating (SIGINT) 13:20:32.111287 run patchelf(pid=9598): Terminated: ok {rc=0} 13:20:32.244409 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9595): Process ended prematurely: osmo-stp_10.42.42.5(pid=9595) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9595)] [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:20:32.254996 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:20:32.284653 run osmo-hlr_10.42.42.2(pid=9592): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9592)] 13:20:32.335720 run osmo-hlr_10.42.42.2(pid=9592): stdout: | (launched: 2022-12-09_13:20:28.791692) 13:20:32.388289 run osmo-hlr_10.42.42.2(pid=9592): stderr: | 20221209132028991 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132028991 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132028991 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132028991 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132028991 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132028991 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132029003 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132029012 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132029012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132029012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:32.441429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9585): Terminating (SIGTERM) 13:20:32.483887 run iperf3-srv_10.42.42.10(pid=9586): Terminating (SIGTERM) 13:20:32.526323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9587): Terminating (SIGTERM) 13:20:32.568514 run iperf3-srv_10.42.42.10(pid=9588): Terminating (SIGTERM) 13:20:32.610825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9591): Terminating (SIGTERM) 13:20:32.653193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9594): Terminating (SIGTERM) 13:20:32.695620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9597): Terminating (SIGTERM) 13:20:32.738336 --- ParallelTerminationStrategy: PID 9585 died... 13:20:32.758559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9585): Terminated: ok {rc=0} 13:20:32.805396 --- ParallelTerminationStrategy: PID 9586 died... 13:20:32.825125 run iperf3-srv_10.42.42.10(pid=9586): Terminated {rc=256} 13:20:32.871649 --- ParallelTerminationStrategy: PID 9587 died... 13:20:32.891313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9587): Terminated: ok {rc=0} 13:20:32.937939 --- ParallelTerminationStrategy: PID 9588 died... 13:20:32.957659 run iperf3-srv_10.42.42.10(pid=9588): Terminated {rc=256} 13:20:33.004397 --- ParallelTerminationStrategy: PID 9591 died... 13:20:33.024179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9591): Terminated: ok {rc=0} 13:20:33.071022 --- ParallelTerminationStrategy: PID 9594 died... 13:20:33.090710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9594): Terminated: ok {rc=0} 13:20:33.137479 --- ParallelTerminationStrategy: PID 9597 died... 13:20:33.157250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9597): Terminated: ok {rc=0} 13:20:33.245883 bus /gobi_0: Setting Powered False 13:20:34.343763 bus /gobi_0: Setting Powered False 13:20:35.460397 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:20:36.610082 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:36.622602 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:20:36.699184 tst iperf3.py: using LAC 21735 13:20:36.828659 tst iperf3.py: using RAC 60 13:20:36.950600 tst iperf3.py: using CellId 21735 13:20:37.073339 tst iperf3.py: using BVCI 21736 13:20:37.185189 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:37.196468 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:37.207556 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:37.218613 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:37.229512 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:37.240524 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:37.251469 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:37.262297 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:37.273323 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:20:37.391368 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:20:37.613072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:20:37.941576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9599): Launched 13:20:38.229185 run iperf3-srv_10.42.42.10(pid=9600): Launched 13:20:38.353135 tst iperf3.py:8: start network... 13:20:38.574791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:39.084031 run create_hlr_db(pid=9601): Launched 13:20:39.208399 bus /gobi_6: Setting Powered False 13:20:40.273067 run create_hlr_db(pid=9601): Terminated: ok {rc=0} 13:20:40.728271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9603): Launched 13:20:41.055938 run osmo-hlr_10.42.42.2(pid=9604): Launched 13:20:41.181863 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:41.750283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9606): Launched 13:20:42.079112 run osmo-stp_10.42.42.5(pid=9607): Launched 13:20:42.206479 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:20:42.773543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9609): Launched 13:20:42.900365 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:20:43.178750 run patchelf(pid=9610): Launched 13:20:43.362762 run osmo-stp_10.42.42.5(pid=9607): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9607)] 13:20:43.501868 run osmo-stp_10.42.42.5(pid=9607): stdout: | (launched: 2022-12-09_13:20:42.019185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:43.642357 run osmo-stp_10.42.42.5(pid=9607): stderr: | 20221209132042211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132042211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132042212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132042212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132042213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132042213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132042213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:43.783009 run osmo-stp_10.42.42.5(pid=9607): stdout: | (launched: 2022-12-09_13:20:42.019185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:43.918134 run osmo-stp_10.42.42.5(pid=9607): stderr: | 20221209132042211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132042211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132042212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132042212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132042213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132042213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132042213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:44.078746 run patchelf(pid=9610): Terminating (SIGINT) 13:20:44.261339 run patchelf(pid=9610): Terminated: ok {rc=0} 13:20:44.393851 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9607): Process ended prematurely: osmo-stp_10.42.42.5(pid=9607) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9607)] [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 13:20:44.404103 tst iperf3.py:8: Test FAILED (7.8 sec) 13:20:44.433327 run osmo-hlr_10.42.42.2(pid=9604): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9604)] 13:20:44.483607 run osmo-hlr_10.42.42.2(pid=9604): stdout: | (launched: 2022-12-09_13:20:40.995507) 13:20:44.535583 run osmo-hlr_10.42.42.2(pid=9604): stderr: | 20221209132041194 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132041194 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132041194 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132041194 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132041194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132041194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132041207 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132041217 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132041217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132041217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:44.588210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9599): Terminating (SIGTERM) 13:20:44.631362 run iperf3-srv_10.42.42.10(pid=9600): Terminating (SIGTERM) 13:20:44.673521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9603): Terminating (SIGTERM) 13:20:44.715707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9606): Terminating (SIGTERM) 13:20:44.757513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9609): Terminating (SIGTERM) 13:20:44.800238 --- ParallelTerminationStrategy: PID 9599 died... 13:20:44.820313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9599): Terminated: ok {rc=0} 13:20:44.867592 --- ParallelTerminationStrategy: PID 9600 died... 13:20:44.887044 run iperf3-srv_10.42.42.10(pid=9600): Terminated {rc=256} 13:20:44.933604 --- ParallelTerminationStrategy: PID 9603 died... 13:20:44.953227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9603): Terminated: ok {rc=0} 13:20:45.000201 --- ParallelTerminationStrategy: PID 9606 died... 13:20:45.020234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9606): Terminated: ok {rc=0} 13:20:45.066873 --- ParallelTerminationStrategy: PID 9609 died... 13:20:45.086409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9609): Terminated: ok {rc=0} 13:20:45.174514 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:20:46.322323 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:46.334742 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:20:46.407019 tst iperf3m4.py: using LAC 21736 13:20:46.541544 tst iperf3m4.py: using RAC 61 13:20:46.705184 tst iperf3m4.py: using CellId 21736 13:20:46.851484 tst iperf3m4.py: using BVCI 21737 13:20:46.997989 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:47.010178 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:47.022369 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:47.035587 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:47.049177 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:47.060915 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:47.073752 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:47.086730 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:20:47.099391 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:20:47.223526 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:20:47.346113 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:20:47.467531 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:20:47.587216 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:20:47.794547 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:20:48.103823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9612): Launched 13:20:48.373302 run iperf3-srv_10.42.42.10(pid=9613): Launched 13:20:48.490189 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:20:48.697108 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:20:49.008293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9614): Launched 13:20:49.277387 run iperf3-srv_10.42.42.10(pid=9615): Launched 13:20:49.393631 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:20:49.599562 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:20:49.908909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9616): Launched 13:20:50.177700 run iperf3-srv_10.42.42.10(pid=9617): Launched 13:20:50.293099 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:20:50.499840 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:20:50.808392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9618): Launched 13:20:51.076550 run iperf3-srv_10.42.42.10(pid=9619): Launched 13:20:51.191335 tst iperf3m4.py:8: start network... 13:20:51.396217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:51.873265 run create_hlr_db(pid=9620): Launched 13:20:51.999708 bus /gobi_6: Setting Powered False 13:20:53.060251 run create_hlr_db(pid=9620): Terminated: ok {rc=0} 13:20:53.489256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9622): Launched 13:20:53.797668 run osmo-hlr_10.42.42.2(pid=9623): Launched 13:20:53.915237 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:54.463909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9625): Launched 13:20:54.773350 run osmo-stp_10.42.42.5(pid=9626): Launched 13:20:54.890372 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:20:55.420028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9628): Launched 13:20:55.537414 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:20:55.796247 run patchelf(pid=9629): Launched 13:20:55.966614 run osmo-stp_10.42.42.5(pid=9626): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9626)] 13:20:56.096791 run osmo-stp_10.42.42.5(pid=9626): stdout: | (launched: 2022-12-09_13:20:54.716020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:56.228372 run osmo-stp_10.42.42.5(pid=9626): stderr: | 20221209132054886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132054886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132054886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132054887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132054887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132054887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132054887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:56.359732 run osmo-stp_10.42.42.5(pid=9626): stdout: | (launched: 2022-12-09_13:20:54.716020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:56.486361 run osmo-stp_10.42.42.5(pid=9626): stderr: | 20221209132054886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132054886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132054886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132054887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132054887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132054887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132054887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:56.635563 run patchelf(pid=9629): Terminating (SIGINT) 13:20:56.807100 run patchelf(pid=9629): Terminated: ok {rc=0} 13:20:56.929817 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9626): Process ended prematurely: osmo-stp_10.42.42.5(pid=9626) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9626)] [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:20:56.939226 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:20:56.966407 run osmo-hlr_10.42.42.2(pid=9623): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9623)] 13:20:57.013683 run osmo-hlr_10.42.42.2(pid=9623): stdout: | (launched: 2022-12-09_13:20:53.740719) 13:20:57.062738 run osmo-hlr_10.42.42.2(pid=9623): stderr: | 20221209132053915 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132053916 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132053916 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132053916 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132053916 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132053916 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132053928 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132053936 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132053937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132053937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:57.112083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9612): Terminating (SIGTERM) 13:20:57.151531 run iperf3-srv_10.42.42.10(pid=9613): Terminating (SIGTERM) 13:20:57.191132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9614): Terminating (SIGTERM) 13:20:57.230639 run iperf3-srv_10.42.42.10(pid=9615): Terminating (SIGTERM) 13:20:57.270119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9616): Terminating (SIGTERM) 13:20:57.309601 run iperf3-srv_10.42.42.10(pid=9617): Terminating (SIGTERM) 13:20:57.348881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9618): Terminating (SIGTERM) 13:20:57.388256 run iperf3-srv_10.42.42.10(pid=9619): Terminating (SIGTERM) 13:20:57.427588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9622): Terminating (SIGTERM) 13:20:57.467141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9625): Terminating (SIGTERM) 13:20:57.506995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9628): Terminating (SIGTERM) 13:20:57.547084 --- ParallelTerminationStrategy: PID 9612 died... 13:20:57.566344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9612): Terminated: ok {rc=0} 13:20:57.610621 --- ParallelTerminationStrategy: PID 9613 died... 13:20:57.629393 run iperf3-srv_10.42.42.10(pid=9613): Terminated {rc=256} 13:20:57.673041 --- ParallelTerminationStrategy: PID 9614 died... 13:20:57.691886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9614): Terminated: ok {rc=0} 13:20:57.736074 --- ParallelTerminationStrategy: PID 9615 died... 13:20:57.754670 run iperf3-srv_10.42.42.10(pid=9615): Terminated {rc=256} 13:20:57.798295 --- ParallelTerminationStrategy: PID 9616 died... 13:20:57.816847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9616): Terminated: ok {rc=0} 13:20:57.860395 --- ParallelTerminationStrategy: PID 9617 died... 13:20:57.878963 run iperf3-srv_10.42.42.10(pid=9617): Terminated {rc=256} 13:20:57.922459 --- ParallelTerminationStrategy: PID 9618 died... 13:20:57.941253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9618): Terminated: ok {rc=0} 13:20:57.984819 --- ParallelTerminationStrategy: PID 9619 died... 13:20:58.003453 run iperf3-srv_10.42.42.10(pid=9619): Terminated {rc=256} 13:20:58.047145 --- ParallelTerminationStrategy: PID 9622 died... 13:20:58.065870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9622): Terminated: ok {rc=0} 13:20:58.109724 --- ParallelTerminationStrategy: PID 9625 died... 13:20:58.128417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9625): Terminated: ok {rc=0} 13:20:58.172137 --- ParallelTerminationStrategy: PID 9628 died... 13:20:58.190789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9628): Terminated: ok {rc=0} 13:20:58.276324 bus /gobi_4: Setting Powered False 13:20:59.376892 bus /gobi_4: Setting Powered False 13:21:00.492333 bus /gobi_1: Setting Powered False 13:21:01.599271 bus /gobi_1: Setting Powered False 13:21:02.724838 bus /gobi_0: Setting Powered False 13:21:03.823800 bus /gobi_0: Setting Powered False 13:21:04.943607 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:21:06.047965 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:21:06.059781 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:21:06.131561 tst ping.py: using LAC 21737 13:21:06.251335 tst ping.py: using RAC 62 13:21:06.370920 tst ping.py: using CellId 21737 13:21:06.497418 tst ping.py: using BVCI 21738 13:21:06.607914 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:21:06.619045 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:21:06.629988 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:21:06.640872 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:21:06.652186 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:21:06.663104 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:21:06.674138 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:21:06.684942 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:21:06.803220 tst ping.py:19: start network... 13:21:07.020625 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:07.519236 run create_hlr_db(pid=9631): Launched 13:21:07.643825 bus /gobi_6: Setting Powered False 13:21:08.707685 run create_hlr_db(pid=9631): Terminated: ok {rc=0} 13:21:09.157205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9633): Launched 13:21:09.479304 run osmo-hlr_10.42.42.2(pid=9634): Launched 13:21:09.604459 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:10.168828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9636): Launched 13:21:10.489614 run osmo-stp_10.42.42.5(pid=9637): Launched 13:21:10.612650 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:21:11.166960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9639): Launched 13:21:11.291306 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:21:11.562813 run patchelf(pid=9640): Launched 13:21:11.740561 run osmo-stp_10.42.42.5(pid=9637): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9637)] 13:21:11.876574 run osmo-stp_10.42.42.5(pid=9637): stdout: | (launched: 2022-12-09_13:21:10.430527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:12.014228 run osmo-stp_10.42.42.5(pid=9637): stderr: | 20221209132110623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132110623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132110623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132110624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132110624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132110624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132110624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:12.152367 run osmo-stp_10.42.42.5(pid=9637): stdout: | (launched: 2022-12-09_13:21:10.430527) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:12.284364 run osmo-stp_10.42.42.5(pid=9637): stderr: | 20221209132110623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132110623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132110623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132110624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132110624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132110624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132110624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:12.440149 run patchelf(pid=9640): Terminating (SIGINT) 13:21:12.619885 run patchelf(pid=9640): Terminated: ok {rc=0} 13:21:12.749418 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9637): Process ended prematurely: osmo-stp_10.42.42.5(pid=9637) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9637)] [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 13:21:12.759046 tst ping.py:22: Test FAILED (6.7 sec) 13:21:12.787683 run osmo-hlr_10.42.42.2(pid=9634): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9634)] 13:21:12.837986 run osmo-hlr_10.42.42.2(pid=9634): stdout: | (launched: 2022-12-09_13:21:09.420488) 13:21:12.890089 run osmo-hlr_10.42.42.2(pid=9634): stderr: | 20221209132109617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132109617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132109617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132109618 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132109618 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132109618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132109630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132109639 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132109639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132109639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:12.942684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9633): Terminating (SIGTERM) 13:21:12.984804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9636): Terminating (SIGTERM) 13:21:13.027350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9639): Terminating (SIGTERM) 13:21:13.069870 --- ParallelTerminationStrategy: PID 9633 died... 13:21:13.090071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9633): Terminated: ok {rc=0} 13:21:13.136760 --- ParallelTerminationStrategy: PID 9636 died... 13:21:13.156246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9636): Terminated: ok {rc=0} 13:21:13.203015 --- ParallelTerminationStrategy: PID 9639 died... 13:21:13.222661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9639): Terminated: ok {rc=0} 13:21:13.310272 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:21:14.398085 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:21:14.410438 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:21:14.482769 tst ping_idle_ping.py: using LAC 21738 13:21:14.603157 tst ping_idle_ping.py: using RAC 63 13:21:14.724151 tst ping_idle_ping.py: using CellId 21738 13:21:14.846358 tst ping_idle_ping.py: using BVCI 21739 13:21:14.958706 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:21:14.969896 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:21:14.980772 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:21:14.991748 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:21:15.002639 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:21:15.013654 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:21:15.024783 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:21:15.035746 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:21:15.150259 tst ping_idle_ping.py:24: start network... 13:21:15.353453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:15.837312 run create_hlr_db(pid=9641): Launched 13:21:16.001255 bus /gobi_6: Setting Powered False 13:21:17.075483 run create_hlr_db(pid=9641): Terminated: ok {rc=0} 13:21:17.525786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9643): Launched 13:21:17.848381 run osmo-hlr_10.42.42.2(pid=9644): Launched 13:21:17.971740 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:18.529448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9646): Launched 13:21:18.853301 run osmo-stp_10.42.42.5(pid=9647): Launched 13:21:18.976290 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:21:19.534747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9649): Launched 13:21:19.658232 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:21:19.931384 run patchelf(pid=9650): Launched 13:21:20.111697 run osmo-stp_10.42.42.5(pid=9647): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9647)] 13:21:20.248646 run osmo-stp_10.42.42.5(pid=9647): stdout: | (launched: 2022-12-09_13:21:18.793779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:20.386933 run osmo-stp_10.42.42.5(pid=9647): stderr: | 20221209132118985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132118985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132118986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132118986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132118987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132118987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132118987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:20.525213 run osmo-stp_10.42.42.5(pid=9647): stdout: | (launched: 2022-12-09_13:21:18.793779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:20.657510 run osmo-stp_10.42.42.5(pid=9647): stderr: | 20221209132118985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132118985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132118986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132118986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132118987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132118987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132118987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:20.814891 run patchelf(pid=9650): Terminating (SIGINT) 13:21:20.995559 run patchelf(pid=9650): Terminated: ok {rc=0} 13:21:21.126474 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9647): Process ended prematurely: osmo-stp_10.42.42.5(pid=9647) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9647)] [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:21:21.135923 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:21:21.164409 run osmo-hlr_10.42.42.2(pid=9644): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9644)] 13:21:21.214820 run osmo-hlr_10.42.42.2(pid=9644): stdout: | (launched: 2022-12-09_13:21:17.789488) 13:21:21.267322 run osmo-hlr_10.42.42.2(pid=9644): stderr: | 20221209132117987 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132117987 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132117987 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132117987 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132117987 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132117987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132117999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132118008 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132118008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132118008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:21.320004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9643): Terminating (SIGTERM) 13:21:21.362350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9646): Terminating (SIGTERM) 13:21:21.404190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9649): Terminating (SIGTERM) 13:21:21.446923 --- ParallelTerminationStrategy: PID 9643 died... 13:21:21.466987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9643): Terminated: ok {rc=0} 13:21:21.513545 --- ParallelTerminationStrategy: PID 9646 died... 13:21:21.533193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9646): Terminated: ok {rc=0} 13:21:21.579717 --- ParallelTerminationStrategy: PID 9649 died... 13:21:21.599341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9649): Terminated: ok {rc=0} 13:21:21.687351 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:21:23.008758 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:21:23.016406 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:21:23.052521 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:21:23.088471 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:21:23.141246 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:21:23.175372 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:21:23.210308 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:21:23.775737 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2360 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:21:23.781833 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:21:23.793821 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:21:23.865401 tst switch_tch_pdch.py: using LAC 21739 13:21:23.988676 tst switch_tch_pdch.py: using RAC 64 13:21:24.107460 tst switch_tch_pdch.py: using CellId 21739 13:21:24.224462 tst switch_tch_pdch.py: using BVCI 21740 13:21:24.334165 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:21:24.345577 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:21:24.356629 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:21:24.368417 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:21:24.380030 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:21:24.391632 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:21:24.403407 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:21:24.415129 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:21:24.535676 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:21:24.654600 tst switch_tch_pdch.py:51: start network... 13:21:24.871502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:25.371057 run create_hlr_db(pid=9655): Launched 13:21:25.494492 bus /gobi_6: Setting Powered False 13:21:26.557882 run create_hlr_db(pid=9655): Terminated: ok {rc=0} 13:21:26.989657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9657): Launched 13:21:27.292781 run osmo-hlr_10.42.42.2(pid=9658): Launched 13:21:27.408932 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:27.930406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9660): Launched 13:21:28.231044 run osmo-stp_10.42.42.5(pid=9661): Launched 13:21:28.346498 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:21:28.866496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9663): Launched 13:21:28.981195 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:21:29.235340 run patchelf(pid=9664): Launched 13:21:29.402525 run osmo-stp_10.42.42.5(pid=9661): ERR: Terminated: ERROR {rc=1} [trial-2360↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9661)] 13:21:29.529816 run osmo-stp_10.42.42.5(pid=9661): stdout: | (launched: 2022-12-09_13:21:28.175192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:29.658394 run osmo-stp_10.42.42.5(pid=9661): stderr: | 20221209132128345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132128345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132128345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132128346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132128346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132128346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132128346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:29.786923 run osmo-stp_10.42.42.5(pid=9661): stdout: | (launched: 2022-12-09_13:21:28.175192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:29.910010 run osmo-stp_10.42.42.5(pid=9661): stderr: | 20221209132128345 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132128345 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132128345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132128346 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132128346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132128346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132128346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:30.055522 run patchelf(pid=9664): Terminating (SIGINT) 13:21:30.223818 run patchelf(pid=9664): Terminated: ok {rc=0} 13:21:30.344539 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9661): Process ended prematurely: osmo-stp_10.42.42.5(pid=9661) [trial-2360↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9661)] [trial-2360↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:21:30.353404 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 13:21:30.379817 run osmo-hlr_10.42.42.2(pid=9658): ERR: Terminated: ERROR {rc=237} [trial-2360↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9658)] 13:21:30.427152 run osmo-hlr_10.42.42.2(pid=9658): stdout: | (launched: 2022-12-09_13:21:27.237100) 13:21:30.476348 run osmo-hlr_10.42.42.2(pid=9658): stderr: | 20221209132127414 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132127414 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132127414 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132127414 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132127414 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132127414 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132127426 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132127435 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132127435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132127435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:30.525771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9657): Terminating (SIGTERM) 13:21:30.565189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9660): Terminating (SIGTERM) 13:21:30.604605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9663): Terminating (SIGTERM) 13:21:30.644069 --- ParallelTerminationStrategy: PID 9657 died... 13:21:30.663184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9657): Terminated: ok {rc=0} 13:21:30.706653 --- ParallelTerminationStrategy: PID 9660 died... 13:21:30.725119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9660): Terminated: ok {rc=0} 13:21:30.769149 --- ParallelTerminationStrategy: PID 9663 died... 13:21:30.787618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9663): Terminated: ok {rc=0} 13:21:30.895018 bus /gobi_0: Setting Powered False 13:21:31.994622 bus /gobi_0: Setting Powered False 13:21:33.106921 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:21:34.365356 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:21:34.371705 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:21:34.405263 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:21:34.439956 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:21:34.493589 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:21:34.527296 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:21:34.561785 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:21:35.118179 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2360 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:21:35.123148 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:21:35.134338 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:21:35.204597 tst switch_tch_pdch.py: using LAC 21740 13:21:35.322212 tst switch_tch_pdch.py: using RAC 65 13:21:35.440436 tst switch_tch_pdch.py: using CellId 21740 13:21:35.560820 tst switch_tch_pdch.py: using BVCI 21741 13:21:35.669900 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:21:35.680895 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:21:35.691823 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:21:35.702784 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:21:35.713721 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:21:35.724582 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:21:35.735561 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:21:35.746418 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:21:35.863530 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:21:35.983028 tst switch_tch_pdch.py:51: start network... 13:21:36.200093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:36.670707 run create_hlr_db(pid=9669): Launched 13:21:36.795115 bus /gobi_6: Setting Powered False 13:21:37.858444 run create_hlr_db(pid=9669): Terminated: ok {rc=0} 13:21:38.264419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9671): Launched 13:21:38.566806 run osmo-hlr_10.42.42.2(pid=9672): Launched 13:21:38.681116 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:39.173565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9674): Launched 13:21:39.473922 run osmo-stp_10.42.42.5(pid=9675): Launched 13:21:39.588790 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:21:40.082797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9677): Launched 13:21:40.198405 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:21:40.453337 run patchelf(pid=9678): Launched 13:21:40.620493 run osmo-stp_10.42.42.5(pid=9675): ERR: Terminated: ERROR {rc=1} [trial-2360↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9675)] 13:21:40.748163 run osmo-stp_10.42.42.5(pid=9675): stdout: | (launched: 2022-12-09_13:21:39.418294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:40.878134 run osmo-stp_10.42.42.5(pid=9675): stderr: | 20221209132139589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132139589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132139590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132139590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132139590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132139590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132139591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:41.006946 run osmo-stp_10.42.42.5(pid=9675): stdout: | (launched: 2022-12-09_13:21:39.418294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:41.130251 run osmo-stp_10.42.42.5(pid=9675): stderr: | 20221209132139589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132139589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132139590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132139590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132139590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132139590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132139591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:41.275981 run patchelf(pid=9678): Terminating (SIGINT) 13:21:41.443778 run patchelf(pid=9678): Terminated: ok {rc=0} 13:21:41.564653 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9675): Process ended prematurely: osmo-stp_10.42.42.5(pid=9675) [trial-2360↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9675)] [trial-2360↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:21:41.573538 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 13:21:41.599914 run osmo-hlr_10.42.42.2(pid=9672): ERR: Terminated: ERROR {rc=237} [trial-2360↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9672)] 13:21:41.647178 run osmo-hlr_10.42.42.2(pid=9672): stdout: | (launched: 2022-12-09_13:21:38.511010) 13:21:41.696249 run osmo-hlr_10.42.42.2(pid=9672): stderr: | 20221209132138689 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132138689 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132138689 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132138689 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132138689 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132138689 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132138701 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132138710 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132138710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132138710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:41.745619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9671): Terminating (SIGTERM) 13:21:41.785282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9674): Terminating (SIGTERM) 13:21:41.824920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9677): Terminating (SIGTERM) 13:21:41.864585 --- ParallelTerminationStrategy: PID 9671 died... 13:21:41.883606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9671): Terminated: ok {rc=0} 13:21:41.927385 --- ParallelTerminationStrategy: PID 9674 died... 13:21:41.945899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9674): Terminated: ok {rc=0} 13:21:41.989610 --- ParallelTerminationStrategy: PID 9677 died... 13:21:42.008140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9677): Terminated: ok {rc=0} 13:21:42.093332 bus /gobi_0: Setting Powered False 13:21:43.193299 bus /gobi_0: Setting Powered False 13:21:44.308005 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_sms:trx-umtrx --------------------------------------------------------------------- 13:21:45.565273 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:21:45.569331 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:21:45.601775 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 13:21:45.608563 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 13:21:45.661124 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:21:45.694770 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 13:21:45.701959 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 13:21:46.246945 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 13:21:46.253432 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 13:21:46.265648 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 13:21:46.314227 tst mo_mt_sms.py: using LAC 21741 13:21:46.476081 tst mo_mt_sms.py: using RAC 66 13:21:46.644712 tst mo_mt_sms.py: using CellId 21741 13:21:46.807270 tst mo_mt_sms.py: using BVCI 21742 13:21:46.939888 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 13:21:47.075293 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 13:21:47.200254 tst mo_mt_sms.py:9: start nitb and bts... 13:21:47.422195 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:21:48.079601 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9682): Launched 13:21:48.403604 run osmo-nitb_10.42.42.2(pid=9683): Launched 13:21:48.582132 run osmo-nitb_10.42.42.2(pid=9683): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9683)] 13:21:48.726785 run osmo-nitb_10.42.42.2(pid=9683): stdout: | (launched: 2022-12-09_13:21:48.344740) 13:21:48.872667 run osmo-nitb_10.42.42.2(pid=9683): stderr: | (launched: 2022-12-09_13:21:48.392856) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:21:49.018718 run osmo-nitb_10.42.42.2(pid=9683): stdout: | (launched: 2022-12-09_13:21:48.344740) 13:21:49.159801 run osmo-nitb_10.42.42.2(pid=9683): stderr: | (launched: 2022-12-09_13:21:48.392856) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9683): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9683) [trial-2360↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9683)] 13:21:49.525468 tst osmo-nitb_10.42.42.2(pid=9683): stdout: | (launched: 2022-12-09_13:21:48.344740) 13:21:49.655009 tst osmo-nitb_10.42.42.2(pid=9683): stderr: | (launched: 2022-12-09_13:21:48.392856) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:21:49.808190 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9683): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9683) [trial-2360↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9683)] [trial-2360↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 13:21:49.817432 tst mo_mt_sms.py:11: Test FAILED (3.6 sec) 13:21:49.824644 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9682): Terminating (SIGTERM) 13:21:50.036242 --- ParallelTerminationStrategy: PID 9682 died... 13:21:50.058107 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9682): Terminated: ok {rc=0} 13:21:50.147445 bus /sierra_3: Setting Powered False 13:21:51.248637 bus /sierra_3: Setting Powered False 13:21:52.366605 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 sms:trx-umtrx --------------------------------------------------------------------- 13:21:53.566600 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:21:53.571108 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:21:53.605840 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 13:21:53.633438 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 13:21:53.687697 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:21:53.721450 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 13:21:53.748610 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 13:21:54.294856 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 13:21:54.299968 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:21:54.311057 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 13:21:54.359111 tst mo_mt_sms.py: using LAC 21742 13:21:54.486730 tst mo_mt_sms.py: using RAC 67 13:21:54.611861 tst mo_mt_sms.py: using CellId 21742 13:21:54.736909 tst mo_mt_sms.py: using BVCI 21743 13:21:54.853391 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:21:54.864350 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:21:54.875345 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:21:54.886219 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:21:54.897749 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:21:54.909429 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 13:21:55.024243 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 13:21:55.142913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:55.642070 run create_hlr_db(pid=9687): Launched 13:21:55.765456 bus /sierra_2: Setting Powered False 13:21:56.829174 run create_hlr_db(pid=9687): Terminated: ok {rc=0} 13:21:57.260109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9689): Launched 13:21:57.563610 run osmo-hlr_10.42.42.2(pid=9690): Launched 13:21:57.678267 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:58.196839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9692): Launched 13:21:58.499777 run osmo-stp_10.42.42.5(pid=9693): Launched 13:21:58.615732 run osmo-msc_10.42.42.6: Starting osmo-msc 13:21:59.161765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9695): Launched 13:21:59.462636 run osmo-msc_10.42.42.6(pid=9696): Launched 13:21:59.631323 run osmo-stp_10.42.42.5(pid=9693): ERR: Terminated: ERROR {rc=1} [trial-2360↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9693)] 13:21:59.758956 run osmo-stp_10.42.42.5(pid=9693): stdout: | (launched: 2022-12-09_13:21:58.443353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:59.886917 run osmo-stp_10.42.42.5(pid=9693): stderr: | 20221209132158613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132158613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132158614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132158614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132158615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132158615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132158615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:00.012497 run osmo-stp_10.42.42.5(pid=9693): stdout: | (launched: 2022-12-09_13:21:58.443353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:00.132589 run osmo-stp_10.42.42.5(pid=9693): stderr: | 20221209132158613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132158613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132158614 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132158614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132158615 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132158615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132158615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:00.275501 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9693): Process ended prematurely: osmo-stp_10.42.42.5(pid=9693) [trial-2360↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9693)] [trial-2360↪sms:trx-umtrx↪mo_mt_sms.py:16] 13:22:00.283792 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 13:22:00.309478 run osmo-hlr_10.42.42.2(pid=9690): ERR: Terminated: ERROR {rc=237} [trial-2360↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9690)] 13:22:00.356894 run osmo-hlr_10.42.42.2(pid=9690): stdout: | (launched: 2022-12-09_13:21:57.507326) 13:22:00.406058 run osmo-hlr_10.42.42.2(pid=9690): stderr: | 20221209132157683 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132157683 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132157683 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132157683 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132157683 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132157683 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132157698 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132157707 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132157707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132157707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:00.474876 run osmo-msc_10.42.42.6(pid=9696): ERR: Terminated: ERROR {rc=2} [trial-2360↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9696)] 13:22:00.522530 run osmo-msc_10.42.42.6(pid=9696): stdout: | (launched: 2022-12-09_13:21:59.407140) 13:22:00.571631 run osmo-msc_10.42.42.6(pid=9696): stderr: | 20221209132159677 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132159677 DLGLOBAL DEBUG validating counter group 0x7fe613bb5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132159678 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132159678 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132159678 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132159678 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132159680 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132159680 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132159680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132159680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:22:00.621750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9689): Terminating (SIGTERM) 13:22:00.661509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9692): Terminating (SIGTERM) 13:22:00.701153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9695): Terminating (SIGTERM) 13:22:00.741029 --- ParallelTerminationStrategy: PID 9689 died... 13:22:00.759917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9689): Terminated: ok {rc=0} 13:22:00.803499 --- ParallelTerminationStrategy: PID 9692 died... 13:22:00.822123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9692): Terminated: ok {rc=0} 13:22:00.883580 --- ParallelTerminationStrategy: PID 9695 died... 13:22:00.915111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9695): Terminated: ok {rc=0} 13:22:01.000405 bus /sierra_3: Setting Powered False 13:22:02.103706 bus /sierra_3: Setting Powered False 13:22:03.227699 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 13:22:04.463192 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:22:04.467489 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:22:04.501219 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 13:22:04.508478 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 13:22:04.545259 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:22:04.577789 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 13:22:04.584813 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 13:22:05.103239 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2360 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 13:22:05.109546 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 13:22:05.120758 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 13:22:05.172649 tst assert_extension.py: using LAC 21743 13:22:05.298600 tst assert_extension.py: using RAC 68 13:22:05.422420 tst assert_extension.py: using CellId 21743 13:22:05.546873 tst assert_extension.py: using BVCI 21744 13:22:05.665524 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 13:22:05.780087 tst assert_extension.py:10: start nitb and bts... 13:22:05.981958 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:22:06.599962 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9701): Launched 13:22:06.901726 run osmo-nitb_10.42.42.2(pid=9702): Launched 13:22:07.069284 run osmo-nitb_10.42.42.2(pid=9702): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9702)] 13:22:07.204744 run osmo-nitb_10.42.42.2(pid=9702): stdout: | (launched: 2022-12-09_13:22:06.846222) 13:22:07.341460 run osmo-nitb_10.42.42.2(pid=9702): stderr: | (launched: 2022-12-09_13:22:06.891040) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:22:07.478208 run osmo-nitb_10.42.42.2(pid=9702): stdout: | (launched: 2022-12-09_13:22:06.846222) 13:22:07.609492 run osmo-nitb_10.42.42.2(pid=9702): stderr: | (launched: 2022-12-09_13:22:06.891040) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9702): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9702) [trial-2360↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9702)] 13:22:08.015611 tst osmo-nitb_10.42.42.2(pid=9702): stdout: | (launched: 2022-12-09_13:22:06.846222) 13:22:08.137154 tst osmo-nitb_10.42.42.2(pid=9702): stderr: | (launched: 2022-12-09_13:22:06.891040) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:22:08.280000 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9702): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9702) [trial-2360↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9702)] [trial-2360↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 13:22:08.288600 tst assert_extension.py:12: Test FAILED (3.2 sec) 13:22:08.295095 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9701): Terminating (SIGTERM) 13:22:08.503504 --- ParallelTerminationStrategy: PID 9701 died... 13:22:08.524177 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9701): Terminated: ok {rc=0} 13:22:08.609830 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 ussd:trx-umtrx --------------------------------------------------------------------- 13:22:09.788391 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:22:09.792336 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:22:09.825993 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 13:22:09.852624 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 13:22:09.889859 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:22:09.922801 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 13:22:09.949498 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 13:22:10.478898 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2360 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 13:22:10.485191 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:22:10.496802 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 13:22:10.548659 tst assert_extension.py: using LAC 21744 13:22:10.677036 tst assert_extension.py: using RAC 69 13:22:10.796147 tst assert_extension.py: using CellId 21744 13:22:10.916545 tst assert_extension.py: using BVCI 21745 13:22:11.025617 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:22:11.036316 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:22:11.047120 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:22:11.060907 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:22:11.073849 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:22:11.085038 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 13:22:11.204642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:11.704522 run create_hlr_db(pid=9706): Launched 13:22:11.827455 bus /sierra_2: Setting Powered False 13:22:12.890594 run create_hlr_db(pid=9706): Terminated: ok {rc=0} 13:22:13.325257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9708): Launched 13:22:13.628525 run osmo-hlr_10.42.42.2(pid=9709): Launched 13:22:13.744721 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:14.282966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9711): Launched 13:22:14.583585 run osmo-stp_10.42.42.5(pid=9712): Launched 13:22:14.697901 run osmo-msc_10.42.42.6: Starting osmo-msc 13:22:15.242750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9714): Launched 13:22:15.542889 run osmo-msc_10.42.42.6(pid=9715): Launched 13:22:15.710678 run osmo-stp_10.42.42.5(pid=9712): ERR: Terminated: ERROR {rc=1} [trial-2360↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9712)] 13:22:15.868873 run osmo-stp_10.42.42.5(pid=9712): stdout: | (launched: 2022-12-09_13:22:14.527701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:16.055252 run osmo-stp_10.42.42.5(pid=9712): stderr: | 20221209132214698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132214698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132214699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132214699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132214699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132214699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132214700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:16.183762 run osmo-stp_10.42.42.5(pid=9712): stdout: | (launched: 2022-12-09_13:22:14.527701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:16.305553 run osmo-stp_10.42.42.5(pid=9712): stderr: | 20221209132214698 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132214698 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132214699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132214699 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132214699 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132214699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132214700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:16.451477 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9712): Process ended prematurely: osmo-stp_10.42.42.5(pid=9712) [trial-2360↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9712)] [trial-2360↪ussd:trx-umtrx↪assert_extension.py:17] 13:22:16.460806 tst assert_extension.py:17: Test FAILED (6.0 sec) 13:22:16.488321 run osmo-hlr_10.42.42.2(pid=9709): ERR: Terminated: ERROR {rc=237} [trial-2360↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9709)] 13:22:16.537734 run osmo-hlr_10.42.42.2(pid=9709): stdout: | (launched: 2022-12-09_13:22:13.572371) 13:22:16.588157 run osmo-hlr_10.42.42.2(pid=9709): stderr: | 20221209132213750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132213750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132213750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132213750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132213750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132213750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132213763 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132213772 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132213772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132213772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:16.658370 run osmo-msc_10.42.42.6(pid=9715): ERR: Terminated: ERROR {rc=2} [trial-2360↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9715)] 13:22:16.707607 run osmo-msc_10.42.42.6(pid=9715): stdout: | (launched: 2022-12-09_13:22:15.487414) 13:22:16.758512 run osmo-msc_10.42.42.6(pid=9715): stderr: | 20221209132215759 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132215759 DLGLOBAL DEBUG validating counter group 0x7fdc2a9fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132215759 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132215759 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132215759 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132215760 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132215762 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132215763 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132215763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132215763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:22:16.809435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9708): Terminating (SIGTERM) 13:22:16.851008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9711): Terminating (SIGTERM) 13:22:16.896437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9714): Terminating (SIGTERM) 13:22:16.943458 --- ParallelTerminationStrategy: PID 9708 died... 13:22:16.964568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9708): Terminated: ok {rc=0} 13:22:17.015965 --- ParallelTerminationStrategy: PID 9711 died... 13:22:17.036779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9711): Terminated: ok {rc=0} 13:22:17.088048 --- ParallelTerminationStrategy: PID 9714 died... 13:22:17.109160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9714): Terminated: ok {rc=0} 13:22:17.201247 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:22:18.416606 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:22:18.423174 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:22:18.455789 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:22:18.482543 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:22:18.535751 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:22:18.570083 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:22:18.598033 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:22:19.147768 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:22:19.201439 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:22:19.213205 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:22:19.284616 tst mo_mt_call.py: using LAC 21745 13:22:19.414835 tst mo_mt_call.py: using RAC 70 13:22:19.544162 tst mo_mt_call.py: using CellId 21745 13:22:19.675043 tst mo_mt_call.py: using BVCI 21746 13:22:19.794319 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:22:19.805930 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:22:19.817433 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:22:19.829005 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:22:19.841064 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:22:19.853314 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:22:19.969484 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:22:20.087452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:20.566684 run create_hlr_db(pid=9720): Launched 13:22:20.695003 bus /sierra_2: Setting Powered False 13:22:21.755666 run create_hlr_db(pid=9720): Terminated: ok {rc=0} 13:22:22.204533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9722): Launched 13:22:22.533596 run osmo-hlr_10.42.42.2(pid=9723): Launched 13:22:22.660019 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:23.226526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9725): Launched 13:22:23.554176 run osmo-stp_10.42.42.5(pid=9726): Launched 13:22:23.681482 run osmo-msc_10.42.42.6: Starting osmo-msc 13:22:24.275026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9728): Launched 13:22:24.605940 run osmo-msc_10.42.42.6(pid=9729): Launched 13:22:24.790396 run osmo-stp_10.42.42.5(pid=9726): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9726)] 13:22:24.931291 run osmo-stp_10.42.42.5(pid=9726): stdout: | (launched: 2022-12-09_13:22:23.494520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:25.067575 run osmo-stp_10.42.42.5(pid=9726): stderr: | 20221209132223686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132223687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132223687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132223687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132223688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132223688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132223688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:25.205089 run osmo-stp_10.42.42.5(pid=9726): stdout: | (launched: 2022-12-09_13:22:23.494520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:25.336148 run osmo-stp_10.42.42.5(pid=9726): stderr: | 20221209132223686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132223687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132223687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132223687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132223688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132223688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132223688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:25.492729 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9726): Process ended prematurely: osmo-stp_10.42.42.5(pid=9726) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9726)] [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:22:25.502470 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:22:25.530743 run osmo-hlr_10.42.42.2(pid=9723): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9723)] 13:22:25.581512 run osmo-hlr_10.42.42.2(pid=9723): stdout: | (launched: 2022-12-09_13:22:22.473691) 13:22:25.633744 run osmo-hlr_10.42.42.2(pid=9723): stderr: | 20221209132222671 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132222671 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132222671 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132222671 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132222671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132222671 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132222718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132222728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132222728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132222728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:25.706468 run osmo-msc_10.42.42.6(pid=9729): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9729)] 13:22:25.757044 run osmo-msc_10.42.42.6(pid=9729): stdout: | (launched: 2022-12-09_13:22:24.545648) 13:22:25.809197 run osmo-msc_10.42.42.6(pid=9729): stderr: | 20221209132224869 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132224869 DLGLOBAL DEBUG validating counter group 0x7f7ac86edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132224870 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132224870 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132224870 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132224870 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132224872 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132224872 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132224872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132224872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:22:25.861625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9722): Terminating (SIGTERM) 13:22:25.903922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9725): Terminating (SIGTERM) 13:22:25.946149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9728): Terminating (SIGTERM) 13:22:25.988484 --- ParallelTerminationStrategy: PID 9722 died... 13:22:26.008347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9722): Terminated: ok {rc=0} 13:22:26.055035 --- ParallelTerminationStrategy: PID 9725 died... 13:22:26.074844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9725): Terminated: ok {rc=0} 13:22:26.121967 --- ParallelTerminationStrategy: PID 9728 died... 13:22:26.141782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9728): Terminated: ok {rc=0} 13:22:26.231943 bus /sierra_3: Setting Powered False 13:22:27.333148 bus /sierra_3: Setting Powered False 13:22:28.451080 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:22:29.601211 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:22:29.613533 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:22:29.685650 tst mo_mt_call_osmux.py: using LAC 21746 13:22:29.815418 tst mo_mt_call_osmux.py: using RAC 71 13:22:29.943576 tst mo_mt_call_osmux.py: using CellId 21746 13:22:30.072422 tst mo_mt_call_osmux.py: using BVCI 21747 13:22:30.191504 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:22:30.203174 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:22:30.214760 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:22:30.226584 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:22:30.238399 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:22:30.250016 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:22:30.368341 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:22:30.490813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:31.012528 run create_hlr_db(pid=9731): Launched 13:22:31.176579 bus /sierra_2: Setting Powered False 13:22:32.236775 run create_hlr_db(pid=9731): Terminated: ok {rc=0} 13:22:32.667082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9733): Launched 13:22:32.978280 run osmo-hlr_10.42.42.2(pid=9734): Launched 13:22:33.098059 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:33.641249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9736): Launched 13:22:33.949301 run osmo-stp_10.42.42.5(pid=9737): Launched 13:22:34.065819 run osmo-msc_10.42.42.6: Starting osmo-msc 13:22:34.621035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9739): Launched 13:22:34.929194 run osmo-msc_10.42.42.6(pid=9740): Launched 13:22:35.101288 run osmo-stp_10.42.42.5(pid=9737): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9737)] 13:22:35.231793 run osmo-stp_10.42.42.5(pid=9737): stdout: | (launched: 2022-12-09_13:22:33.892483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:35.362665 run osmo-stp_10.42.42.5(pid=9737): stderr: | 20221209132234064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132234064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132234064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132234064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132234065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132234065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132234065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:35.490639 run osmo-stp_10.42.42.5(pid=9737): stdout: | (launched: 2022-12-09_13:22:33.892483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:35.612549 run osmo-stp_10.42.42.5(pid=9737): stderr: | 20221209132234064 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132234064 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132234064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132234064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132234065 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132234065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132234065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:35.758922 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9737): Process ended prematurely: osmo-stp_10.42.42.5(pid=9737) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9737)] [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:22:35.767932 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:22:35.795033 run osmo-hlr_10.42.42.2(pid=9734): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9734)] 13:22:35.843477 run osmo-hlr_10.42.42.2(pid=9734): stdout: | (launched: 2022-12-09_13:22:32.922034) 13:22:35.892517 run osmo-hlr_10.42.42.2(pid=9734): stderr: | 20221209132233099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132233099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132233099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132233099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132233099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132233099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132233111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132233119 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132233120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132233120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:35.961156 run osmo-msc_10.42.42.6(pid=9740): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9740)] 13:22:36.008604 run osmo-msc_10.42.42.6(pid=9740): stdout: | (launched: 2022-12-09_13:22:34.872377) 13:22:36.057592 run osmo-msc_10.42.42.6(pid=9740): stderr: | 20221209132235144 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132235144 DLGLOBAL DEBUG validating counter group 0x7f76a35f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132235144 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132235144 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132235145 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132235145 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132235147 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132235147 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132235147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132235147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:22:36.106913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9733): Terminating (SIGTERM) 13:22:36.146376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9736): Terminating (SIGTERM) 13:22:36.185839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9739): Terminating (SIGTERM) 13:22:36.225505 --- ParallelTerminationStrategy: PID 9733 died... 13:22:36.244476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9733): Terminated: ok {rc=0} 13:22:36.288206 --- ParallelTerminationStrategy: PID 9736 died... 13:22:36.306676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9736): Terminated: ok {rc=0} 13:22:36.350402 --- ParallelTerminationStrategy: PID 9739 died... 13:22:36.368772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9739): Terminated: ok {rc=0} 13:22:36.452615 bus /sierra_3: Setting Powered False 13:22:37.546632 bus /sierra_3: Setting Powered False 13:22:38.661817 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:22:39.911849 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:22:39.918581 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:22:39.950833 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:22:39.977435 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:22:40.029887 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:22:40.062853 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:22:40.089453 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:22:40.638918 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:22:40.687823 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:22:40.699009 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:22:40.767209 tst mo_mt_call.py: using LAC 21747 13:22:40.888150 tst mo_mt_call.py: using RAC 72 13:22:41.015725 tst mo_mt_call.py: using CellId 21747 13:22:41.136215 tst mo_mt_call.py: using BVCI 21748 13:22:41.247807 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:22:41.258949 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:22:41.269916 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:22:41.280788 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:22:41.292119 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:22:41.303129 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:22:41.423383 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:22:41.540574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:42.017144 run create_hlr_db(pid=9746): Launched 13:22:42.142982 bus /sierra_2: Setting Powered False 13:22:43.203686 run create_hlr_db(pid=9746): Terminated: ok {rc=0} 13:22:43.652273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9748): Launched 13:22:43.980118 run osmo-hlr_10.42.42.2(pid=9749): Launched 13:22:44.106244 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:44.670447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9751): Launched 13:22:45.000040 run osmo-stp_10.42.42.5(pid=9752): Launched 13:22:45.125831 run osmo-msc_10.42.42.6: Starting osmo-msc 13:22:45.719261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9754): Launched 13:22:46.062931 run osmo-msc_10.42.42.6(pid=9755): Launched 13:22:46.414431 run osmo-stp_10.42.42.5(pid=9752): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9752)] 13:22:46.607844 run osmo-stp_10.42.42.5(pid=9752): stdout: | (launched: 2022-12-09_13:22:44.939820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:46.783526 run osmo-stp_10.42.42.5(pid=9752): stderr: | 20221209132245134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132245134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132245134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132245135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132245135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132245135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132245135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:46.977249 run osmo-stp_10.42.42.5(pid=9752): stdout: | (launched: 2022-12-09_13:22:44.939820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:47.107303 run osmo-stp_10.42.42.5(pid=9752): stderr: | 20221209132245134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132245134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132245134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132245135 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132245135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132245135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132245135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:47.261828 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9752): Process ended prematurely: osmo-stp_10.42.42.5(pid=9752) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9752)] [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:22:47.271314 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 13:22:47.298572 run osmo-hlr_10.42.42.2(pid=9749): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9749)] 13:22:47.348864 run osmo-hlr_10.42.42.2(pid=9749): stdout: | (launched: 2022-12-09_13:22:43.920033) 13:22:47.400386 run osmo-hlr_10.42.42.2(pid=9749): stderr: | 20221209132244118 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132244118 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132244118 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132244118 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132244118 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132244118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132244132 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132244142 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132244142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132244142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:47.470939 run osmo-msc_10.42.42.6(pid=9755): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9755)] 13:22:47.525374 run osmo-msc_10.42.42.6(pid=9755): stdout: | (launched: 2022-12-09_13:22:46.004380) 13:22:47.574577 run osmo-msc_10.42.42.6(pid=9755): stderr: | 20221209132246611 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132246611 DLGLOBAL DEBUG validating counter group 0x7fbc2beb4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132246611 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132246611 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132246611 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132246612 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132246619 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132246619 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132246619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132246619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:22:47.624230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9748): Terminating (SIGTERM) 13:22:47.663832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9751): Terminating (SIGTERM) 13:22:47.703472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9754): Terminating (SIGTERM) 13:22:47.743323 --- ParallelTerminationStrategy: PID 9748 died... 13:22:47.762441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9748): Terminated: ok {rc=0} 13:22:47.806259 --- ParallelTerminationStrategy: PID 9751 died... 13:22:47.824869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9751): Terminated: ok {rc=0} 13:22:47.869947 --- ParallelTerminationStrategy: PID 9754 died... 13:22:47.888704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9754): Terminated: ok {rc=0} 13:22:47.974982 bus /sierra_3: Setting Powered False 13:22:49.075848 bus /sierra_3: Setting Powered False 13:22:50.192835 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:22:51.344838 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:22:51.357355 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:22:51.430066 tst mo_mt_call_osmux.py: using LAC 21748 13:22:51.566733 tst mo_mt_call_osmux.py: using RAC 73 13:22:51.696327 tst mo_mt_call_osmux.py: using CellId 21748 13:22:51.823639 tst mo_mt_call_osmux.py: using BVCI 21749 13:22:51.945947 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:22:51.957749 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:22:51.969247 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:22:51.980813 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:22:51.992591 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:22:52.004397 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:22:52.125719 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:22:52.248357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:52.726367 run create_hlr_db(pid=9757): Launched 13:22:52.854274 bus /sierra_2: Setting Powered False 13:22:53.914842 run create_hlr_db(pid=9757): Terminated: ok {rc=0} 13:22:54.344398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9759): Launched 13:22:54.653491 run osmo-hlr_10.42.42.2(pid=9760): Launched 13:22:54.772192 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:55.305211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9762): Launched 13:22:55.614110 run osmo-stp_10.42.42.5(pid=9763): Launched 13:22:55.730434 run osmo-msc_10.42.42.6: Starting osmo-msc 13:22:56.284902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9765): Launched 13:22:56.593695 run osmo-msc_10.42.42.6(pid=9766): Launched 13:22:56.766059 run osmo-stp_10.42.42.5(pid=9763): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9763)] 13:22:56.895170 run osmo-stp_10.42.42.5(pid=9763): stdout: | (launched: 2022-12-09_13:22:55.557175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:57.024820 run osmo-stp_10.42.42.5(pid=9763): stderr: | 20221209132255728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132255728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132255729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132255729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132255730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132255730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132255730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:57.152463 run osmo-stp_10.42.42.5(pid=9763): stdout: | (launched: 2022-12-09_13:22:55.557175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:57.274959 run osmo-stp_10.42.42.5(pid=9763): stderr: | 20221209132255728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132255728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132255729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132255729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132255730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132255730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132255730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:57.421226 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9763): Process ended prematurely: osmo-stp_10.42.42.5(pid=9763) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9763)] [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:22:57.430249 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:22:57.457515 run osmo-hlr_10.42.42.2(pid=9760): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9760)] 13:22:57.505252 run osmo-hlr_10.42.42.2(pid=9760): stdout: | (launched: 2022-12-09_13:22:54.596160) 13:22:57.554632 run osmo-hlr_10.42.42.2(pid=9760): stderr: | 20221209132254773 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132254773 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132254773 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132254773 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132254773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132254773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132254785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132254793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132254794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132254794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:57.623212 run osmo-msc_10.42.42.6(pid=9766): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9766)] 13:22:57.670855 run osmo-msc_10.42.42.6(pid=9766): stdout: | (launched: 2022-12-09_13:22:56.537147) 13:22:57.719983 run osmo-msc_10.42.42.6(pid=9766): stderr: | 20221209132256810 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132256810 DLGLOBAL DEBUG validating counter group 0x7f1bae6f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132256810 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132256810 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132256810 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132256810 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132256812 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132256812 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132256813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132256813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:22:57.769487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9759): Terminating (SIGTERM) 13:22:57.809063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9762): Terminating (SIGTERM) 13:22:57.848657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9765): Terminating (SIGTERM) 13:22:57.888305 --- ParallelTerminationStrategy: PID 9759 died... 13:22:57.907440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9759): Terminated: ok {rc=0} 13:22:57.951489 --- ParallelTerminationStrategy: PID 9762 died... 13:22:57.970162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9762): Terminated: ok {rc=0} 13:22:58.013855 --- ParallelTerminationStrategy: PID 9765 died... 13:22:58.032265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9765): Terminated: ok {rc=0} 13:22:58.115578 bus /sierra_3: Setting Powered False 13:22:59.212826 bus /sierra_3: Setting Powered False 13:23:00.328789 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:23:01.590573 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:23:01.604563 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:23:01.643472 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:23:01.673041 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:23:01.731622 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:23:01.780234 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:23:01.820240 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:23:02.406589 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:23:02.469239 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:23:02.481752 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:23:02.560314 tst mo_mt_call.py: using LAC 21749 13:23:02.707188 tst mo_mt_call.py: using RAC 74 13:23:02.858176 tst mo_mt_call.py: using CellId 21749 13:23:02.985962 tst mo_mt_call.py: using BVCI 21750 13:23:03.133087 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:23:03.147011 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:23:03.159056 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:23:03.172378 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:23:03.191070 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:23:03.203068 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:23:03.338964 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:23:03.480712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:04.097493 run create_hlr_db(pid=9979): Launched 13:23:04.281250 bus /sierra_2: Setting Powered False 13:23:05.344109 run create_hlr_db(pid=9979): Terminated: ok {rc=0} 13:23:05.830730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10042): Launched 13:23:06.165637 run osmo-hlr_10.42.42.2(pid=10044): Launched 13:23:06.415441 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:07.076749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10047): Launched 13:23:07.419725 run osmo-stp_10.42.42.5(pid=10048): Launched 13:23:07.675401 run osmo-msc_10.42.42.6: Starting osmo-msc 13:23:08.351866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10050): Launched 13:23:08.696368 run osmo-msc_10.42.42.6(pid=10051): Launched 13:23:09.063837 run osmo-stp_10.42.42.5(pid=10048): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10048)] 13:23:09.353889 run osmo-stp_10.42.42.5(pid=10048): stdout: | (launched: 2022-12-09_13:23:07.359951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:09.521783 run osmo-stp_10.42.42.5(pid=10048): stderr: | 20221209132307654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132307654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132307655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132307655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132307655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132307656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132307656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:09.664059 run osmo-stp_10.42.42.5(pid=10048): stdout: | (launched: 2022-12-09_13:23:07.359951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:09.800180 run osmo-stp_10.42.42.5(pid=10048): stderr: | 20221209132307654 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132307654 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132307655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132307655 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132307655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132307656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132307656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:09.962495 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10048): Process ended prematurely: osmo-stp_10.42.42.5(pid=10048) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10048)] [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:23:09.973375 tst mo_mt_call.py:8: Test FAILED (7.6 sec) 13:23:10.005270 run osmo-hlr_10.42.42.2(pid=10044): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10044)] 13:23:10.058707 run osmo-hlr_10.42.42.2(pid=10044): stdout: | (launched: 2022-12-09_13:23:06.103371) 13:23:10.114583 run osmo-hlr_10.42.42.2(pid=10044): stderr: | 20221209132306392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132306392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132306392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132306392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132306392 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132306392 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132306407 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132306419 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132306419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132306420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:10.191178 run osmo-msc_10.42.42.6(pid=10051): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10051)] 13:23:10.244584 run osmo-msc_10.42.42.6(pid=10051): stdout: | (launched: 2022-12-09_13:23:08.635691) 13:23:10.300031 run osmo-msc_10.42.42.6(pid=10051): stderr: | 20221209132309146 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132309146 DLGLOBAL DEBUG validating counter group 0x7f5d66129c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132309146 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132309146 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132309146 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132309146 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132309148 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132309149 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132309149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132309149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:23:10.355801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10042): Terminating (SIGTERM) 13:23:10.401186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10047): Terminating (SIGTERM) 13:23:10.448229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10050): Terminating (SIGTERM) 13:23:10.495332 --- ParallelTerminationStrategy: PID 10042 died... 13:23:10.516511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10042): Terminated: ok {rc=0} 13:23:10.568549 --- ParallelTerminationStrategy: PID 10047 died... 13:23:10.589810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10047): Terminated: ok {rc=0} 13:23:10.639899 --- ParallelTerminationStrategy: PID 10050 died... 13:23:10.660780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10050): Terminated: ok {rc=0} 13:23:10.754348 bus /sierra_3: Setting Powered False 13:23:11.859390 bus /sierra_3: Setting Powered False 13:23:12.984348 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:23:14.135110 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:23:14.147955 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:23:14.219143 tst mo_mt_call_osmux.py: using LAC 21750 13:23:14.344443 tst mo_mt_call_osmux.py: using RAC 75 13:23:14.468394 tst mo_mt_call_osmux.py: using CellId 21750 13:23:14.593274 tst mo_mt_call_osmux.py: using BVCI 21751 13:23:14.709902 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:23:14.722106 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:23:14.734197 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:23:14.746571 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:23:14.758870 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:23:14.771100 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:23:14.890426 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:23:15.010061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:15.505852 run create_hlr_db(pid=10053): Launched 13:23:15.672581 bus /sierra_2: Setting Powered False 13:23:16.753784 run create_hlr_db(pid=10053): Terminated: ok {rc=0} 13:23:17.210925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10055): Launched 13:23:17.547283 run osmo-hlr_10.42.42.2(pid=10056): Launched 13:23:17.806075 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:18.476833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10058): Launched 13:23:18.814293 run osmo-stp_10.42.42.5(pid=10059): Launched 13:23:19.065311 run osmo-msc_10.42.42.6: Starting osmo-msc 13:23:19.778965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10061): Launched 13:23:20.110993 run osmo-msc_10.42.42.6(pid=10062): Launched 13:23:20.468697 run osmo-stp_10.42.42.5(pid=10059): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10059)] 13:23:20.749218 run osmo-stp_10.42.42.5(pid=10059): stdout: | (launched: 2022-12-09_13:23:18.751807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:21.032112 run osmo-stp_10.42.42.5(pid=10059): stderr: | 20221209132319089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132319089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132319089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132319090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132319090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132319090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132319090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:21.188130 run osmo-stp_10.42.42.5(pid=10059): stdout: | (launched: 2022-12-09_13:23:18.751807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:21.316418 run osmo-stp_10.42.42.5(pid=10059): stderr: | 20221209132319089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132319089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132319089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132319090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132319090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132319090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132319090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:21.469062 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10059): Process ended prematurely: osmo-stp_10.42.42.5(pid=10059) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10059)] [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:23:21.479465 tst mo_mt_call_osmux.py:8: Test FAILED (7.4 sec) 13:23:21.507681 run osmo-hlr_10.42.42.2(pid=10056): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10056)] 13:23:21.560199 run osmo-hlr_10.42.42.2(pid=10056): stdout: | (launched: 2022-12-09_13:23:17.482758) 13:23:21.613211 run osmo-hlr_10.42.42.2(pid=10056): stderr: | 20221209132317757 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132317757 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132317757 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132317757 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132317757 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132317757 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132317775 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132317783 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132317783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132317783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:21.687395 run osmo-msc_10.42.42.6(pid=10062): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10062)] 13:23:21.737337 run osmo-msc_10.42.42.6(pid=10062): stdout: | (launched: 2022-12-09_13:23:20.051320) 13:23:21.789589 run osmo-msc_10.42.42.6(pid=10062): stderr: | 20221209132320643 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132320644 DLGLOBAL DEBUG validating counter group 0x7f705d78bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132320644 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132320644 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132320644 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132320644 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132320654 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132320655 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132320655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132320655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:23:21.841811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10055): Terminating (SIGTERM) 13:23:21.885532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10058): Terminating (SIGTERM) 13:23:21.929782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10061): Terminating (SIGTERM) 13:23:21.974456 --- ParallelTerminationStrategy: PID 10055 died... 13:23:21.994908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10055): Terminated: ok {rc=0} 13:23:22.043871 --- ParallelTerminationStrategy: PID 10058 died... 13:23:22.065145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10058): Terminated: ok {rc=0} 13:23:22.111638 --- ParallelTerminationStrategy: PID 10061 died... 13:23:22.131725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10061): Terminated: ok {rc=0} 13:23:22.219669 bus /sierra_3: Setting Powered False 13:23:23.321363 bus /sierra_3: Setting Powered False 13:23:24.444055 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:23:25.696424 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:23:25.702867 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:23:25.735433 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:23:25.762188 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:23:25.815111 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:23:25.847787 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:23:25.874258 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:23:26.423175 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:23:26.472097 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:23:26.483367 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:23:26.551795 tst mo_mt_call.py: using LAC 21751 13:23:26.673372 tst mo_mt_call.py: using RAC 76 13:23:26.794621 tst mo_mt_call.py: using CellId 21751 13:23:26.917202 tst mo_mt_call.py: using BVCI 21752 13:23:27.030470 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:23:27.041715 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:23:27.052725 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:23:27.063708 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:23:27.074839 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:23:27.085803 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:23:27.206233 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:23:27.326229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:27.807504 run create_hlr_db(pid=10067): Launched 13:23:27.934834 bus /sierra_2: Setting Powered False 13:23:28.995795 run create_hlr_db(pid=10067): Terminated: ok {rc=0} 13:23:29.444270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10069): Launched 13:23:29.774931 run osmo-hlr_10.42.42.2(pid=10070): Launched 13:23:29.900545 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:30.470200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10072): Launched 13:23:30.799439 run osmo-stp_10.42.42.5(pid=10073): Launched 13:23:31.088696 run osmo-msc_10.42.42.6: Starting osmo-msc 13:23:31.790648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10075): Launched 13:23:32.219190 run osmo-msc_10.42.42.6(pid=10076): Launched 13:23:32.516706 run osmo-stp_10.42.42.5(pid=10073): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10073)] 13:23:32.656454 run osmo-stp_10.42.42.5(pid=10073): stdout: | (launched: 2022-12-09_13:23:30.739122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:32.798919 run osmo-stp_10.42.42.5(pid=10073): stderr: | 20221209132330972 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132330972 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132330973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132330973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132330974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132330974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132330974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:32.937209 run osmo-stp_10.42.42.5(pid=10073): stdout: | (launched: 2022-12-09_13:23:30.739122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:33.068354 run osmo-stp_10.42.42.5(pid=10073): stderr: | 20221209132330972 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132330972 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132330973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132330973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132330974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132330974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132330974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:33.225939 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10073): Process ended prematurely: osmo-stp_10.42.42.5(pid=10073) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10073)] [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:23:33.235743 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 13:23:33.264112 run osmo-hlr_10.42.42.2(pid=10070): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10070)] 13:23:33.315597 run osmo-hlr_10.42.42.2(pid=10070): stdout: | (launched: 2022-12-09_13:23:29.714842) 13:23:33.367908 run osmo-hlr_10.42.42.2(pid=10070): stderr: | 20221209132329914 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132329914 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132329914 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132329914 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132329914 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132329914 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132329927 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132329935 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132329935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132329936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:33.440520 run osmo-msc_10.42.42.6(pid=10076): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10076)] 13:23:33.490830 run osmo-msc_10.42.42.6(pid=10076): stdout: | (launched: 2022-12-09_13:23:32.144316) 13:23:33.542827 run osmo-msc_10.42.42.6(pid=10076): stderr: | 20221209132332591 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132332591 DLGLOBAL DEBUG validating counter group 0x7f3161432c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132332591 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132332591 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132332591 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132332591 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132332593 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132332594 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132332594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132332594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:23:33.595313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10069): Terminating (SIGTERM) 13:23:33.637430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10072): Terminating (SIGTERM) 13:23:33.679489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10075): Terminating (SIGTERM) 13:23:33.721743 --- ParallelTerminationStrategy: PID 10069 died... 13:23:33.741509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10069): Terminated: ok {rc=0} 13:23:33.788162 --- ParallelTerminationStrategy: PID 10072 died... 13:23:33.807760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10072): Terminated: ok {rc=0} 13:23:33.854303 --- ParallelTerminationStrategy: PID 10075 died... 13:23:33.873896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10075): Terminated: ok {rc=0} 13:23:33.962256 bus /sierra_3: Setting Powered False 13:23:35.060311 bus /sierra_3: Setting Powered False 13:23:36.177297 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:23:37.325567 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:23:37.338059 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:23:37.410257 tst mo_mt_call_osmux.py: using LAC 21752 13:23:37.540189 tst mo_mt_call_osmux.py: using RAC 77 13:23:37.670043 tst mo_mt_call_osmux.py: using CellId 21752 13:23:37.792352 tst mo_mt_call_osmux.py: using BVCI 21753 13:23:37.905575 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:23:37.916648 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:23:37.927828 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:23:37.938791 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:23:37.949868 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:23:37.960755 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:23:38.078813 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:23:38.196586 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:38.674270 run create_hlr_db(pid=10078): Launched 13:23:38.800725 bus /sierra_2: Setting Powered False 13:23:39.861476 run create_hlr_db(pid=10078): Terminated: ok {rc=0} 13:23:40.310811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10080): Launched 13:23:40.640921 run osmo-hlr_10.42.42.2(pid=10081): Launched 13:23:40.766446 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:41.335816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10083): Launched 13:23:41.663801 run osmo-stp_10.42.42.5(pid=10084): Launched 13:23:41.790602 run osmo-msc_10.42.42.6: Starting osmo-msc 13:23:42.384566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10086): Launched 13:23:42.714427 run osmo-msc_10.42.42.6(pid=10087): Launched 13:23:42.899289 run osmo-stp_10.42.42.5(pid=10084): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10084)] 13:23:43.039792 run osmo-stp_10.42.42.5(pid=10084): stdout: | (launched: 2022-12-09_13:23:41.603585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:43.179786 run osmo-stp_10.42.42.5(pid=10084): stderr: | 20221209132341798 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132341798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132341799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132341799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132341801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132341802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132341802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:43.316774 run osmo-stp_10.42.42.5(pid=10084): stdout: | (launched: 2022-12-09_13:23:41.603585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:43.447235 run osmo-stp_10.42.42.5(pid=10084): stderr: | 20221209132341798 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132341798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132341799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132341799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132341801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132341802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132341802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:43.603197 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10084): Process ended prematurely: osmo-stp_10.42.42.5(pid=10084) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10084)] [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:23:43.612822 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:23:43.641623 run osmo-hlr_10.42.42.2(pid=10081): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10081)] 13:23:43.692252 run osmo-hlr_10.42.42.2(pid=10081): stdout: | (launched: 2022-12-09_13:23:40.580598) 13:23:43.744526 run osmo-hlr_10.42.42.2(pid=10081): stderr: | 20221209132340781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132340781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132340781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132340781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132340781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132340781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132340794 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132340803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132340803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132340803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:43.817874 run osmo-msc_10.42.42.6(pid=10087): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10087)] 13:23:43.868611 run osmo-msc_10.42.42.6(pid=10087): stdout: | (launched: 2022-12-09_13:23:42.653911) 13:23:43.921015 run osmo-msc_10.42.42.6(pid=10087): stderr: | 20221209132342976 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132342976 DLGLOBAL DEBUG validating counter group 0x7f1b8c9ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132342976 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132342976 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132342976 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132342976 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132342978 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132342978 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132342979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132342979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:23:43.973902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10080): Terminating (SIGTERM) 13:23:44.016308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10083): Terminating (SIGTERM) 13:23:44.058712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10086): Terminating (SIGTERM) 13:23:44.101476 --- ParallelTerminationStrategy: PID 10080 died... 13:23:44.121642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10080): Terminated: ok {rc=0} 13:23:44.168621 --- ParallelTerminationStrategy: PID 10083 died... 13:23:44.188337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10083): Terminated: ok {rc=0} 13:23:44.235028 --- ParallelTerminationStrategy: PID 10086 died... 13:23:44.254779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10086): Terminated: ok {rc=0} 13:23:44.344149 bus /sierra_3: Setting Powered False 13:23:45.441348 bus /sierra_3: Setting Powered False 13:23:46.561260 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:23:47.812168 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:23:47.819217 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:23:47.852181 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:23:47.879168 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:23:47.931958 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:23:47.964749 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:23:47.991578 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:23:48.541374 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:23:48.590342 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:48.601619 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:23:48.670581 tst mo_mt_call.py: using LAC 21753 13:23:48.800390 tst mo_mt_call.py: using RAC 78 13:23:48.929834 tst mo_mt_call.py: using CellId 21753 13:23:49.053032 tst mo_mt_call.py: using BVCI 21754 13:23:49.164911 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:49.176242 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:49.187134 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:49.198280 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:49.209368 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:49.220490 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:23:49.341644 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:23:49.461572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:49.972006 run create_hlr_db(pid=10094): Launched 13:23:50.101712 bus /sierra_2: Setting Powered False 13:23:51.163326 run create_hlr_db(pid=10094): Terminated: ok {rc=0} 13:23:51.591452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10096): Launched 13:23:51.900664 run osmo-hlr_10.42.42.2(pid=10097): Launched 13:23:52.017643 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:52.559158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10099): Launched 13:23:52.867284 run osmo-stp_10.42.42.5(pid=10100): Launched 13:23:52.984891 run osmo-msc_10.42.42.6: Starting osmo-msc 13:23:53.538724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10102): Launched 13:23:53.846589 run osmo-msc_10.42.42.6(pid=10103): Launched 13:23:54.019152 run osmo-stp_10.42.42.5(pid=10100): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10100)] 13:23:54.148511 run osmo-stp_10.42.42.5(pid=10100): stdout: | (launched: 2022-12-09_13:23:52.810474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:54.277668 run osmo-stp_10.42.42.5(pid=10100): stderr: | 20221209132352983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132352983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132352984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132352984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132352986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132352987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132352987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:54.405170 run osmo-stp_10.42.42.5(pid=10100): stdout: | (launched: 2022-12-09_13:23:52.810474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:54.527263 run osmo-stp_10.42.42.5(pid=10100): stderr: | 20221209132352983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132352983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132352984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132352984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132352986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132352987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132352987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:54.672731 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10100): Process ended prematurely: osmo-stp_10.42.42.5(pid=10100) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10100)] [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:23:54.681787 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:23:54.708074 run osmo-hlr_10.42.42.2(pid=10097): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10097)] 13:23:54.755371 run osmo-hlr_10.42.42.2(pid=10097): stdout: | (launched: 2022-12-09_13:23:51.842812) 13:23:54.805016 run osmo-hlr_10.42.42.2(pid=10097): stderr: | 20221209132352023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132352023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132352023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132352023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132352023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132352023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132352036 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132352046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132352046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132352047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:54.873386 run osmo-msc_10.42.42.6(pid=10103): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10103)] 13:23:54.920799 run osmo-msc_10.42.42.6(pid=10103): stdout: | (launched: 2022-12-09_13:23:53.789511) 13:23:54.969954 run osmo-msc_10.42.42.6(pid=10103): stderr: | 20221209132354063 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132354063 DLGLOBAL DEBUG validating counter group 0x7f40d40eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132354063 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132354063 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132354063 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132354064 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132354065 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132354066 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132354066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132354066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:23:55.019266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10096): Terminating (SIGTERM) 13:23:55.058748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10099): Terminating (SIGTERM) 13:23:55.098269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10102): Terminating (SIGTERM) 13:23:55.137912 --- ParallelTerminationStrategy: PID 10096 died... 13:23:55.156914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10096): Terminated: ok {rc=0} 13:23:55.200668 --- ParallelTerminationStrategy: PID 10099 died... 13:23:55.219148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10099): Terminated: ok {rc=0} 13:23:55.262450 --- ParallelTerminationStrategy: PID 10102 died... 13:23:55.280998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10102): Terminated: ok {rc=0} 13:23:55.365983 bus /sierra_3: Setting Powered False 13:23:56.467101 bus /sierra_3: Setting Powered False 13:23:57.583247 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:23:58.729086 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:58.740855 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:23:58.810239 tst mo_mt_call_osmux.py: using LAC 21754 13:23:58.933128 tst mo_mt_call_osmux.py: using RAC 79 13:23:59.056187 tst mo_mt_call_osmux.py: using CellId 21754 13:23:59.179664 tst mo_mt_call_osmux.py: using BVCI 21755 13:23:59.292773 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:59.304005 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:59.315044 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:59.326115 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:59.337215 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:59.348217 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:23:59.467090 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:23:59.586719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:00.065199 run create_hlr_db(pid=10105): Launched 13:24:00.190293 bus /sierra_2: Setting Powered False 13:24:01.250410 run create_hlr_db(pid=10105): Terminated: ok {rc=0} 13:24:01.689908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10107): Launched 13:24:02.019477 run osmo-hlr_10.42.42.2(pid=10108): Launched 13:24:02.159340 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:02.743080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10110): Launched 13:24:03.053331 run osmo-stp_10.42.42.5(pid=10111): Launched 13:24:03.170759 run osmo-msc_10.42.42.6: Starting osmo-msc 13:24:03.746786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10113): Launched 13:24:04.057754 run osmo-msc_10.42.42.6(pid=10114): Launched 13:24:04.231167 run osmo-stp_10.42.42.5(pid=10111): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10111)] 13:24:04.369723 run osmo-stp_10.42.42.5(pid=10111): stdout: | (launched: 2022-12-09_13:24:02.996042) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:04.509120 run osmo-stp_10.42.42.5(pid=10111): stderr: | 20221209132403167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132403168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132403168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132403168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132403171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132403171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132403171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:04.637392 run osmo-stp_10.42.42.5(pid=10111): stdout: | (launched: 2022-12-09_13:24:02.996042) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:04.759680 run osmo-stp_10.42.42.5(pid=10111): stderr: | 20221209132403167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132403168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132403168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132403168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132403171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132403171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132403171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:04.906207 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10111): Process ended prematurely: osmo-stp_10.42.42.5(pid=10111) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10111)] [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:24:04.915059 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:24:04.941527 run osmo-hlr_10.42.42.2(pid=10108): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10108)] 13:24:04.989087 run osmo-hlr_10.42.42.2(pid=10108): stdout: | (launched: 2022-12-09_13:24:01.960925) 13:24:05.038074 run osmo-hlr_10.42.42.2(pid=10108): stderr: | 20221209132402276 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132402276 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132402276 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132402276 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132402276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132402276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132402288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132402298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132402298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132402298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:05.107038 run osmo-msc_10.42.42.6(pid=10114): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10114)] 13:24:05.154352 run osmo-msc_10.42.42.6(pid=10114): stdout: | (launched: 2022-12-09_13:24:04.000627) 13:24:05.203416 run osmo-msc_10.42.42.6(pid=10114): stderr: | 20221209132404276 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132404277 DLGLOBAL DEBUG validating counter group 0x7f426685fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132404277 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132404277 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132404277 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132404277 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132404279 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132404279 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132404279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132404279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:24:05.252818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10107): Terminating (SIGTERM) 13:24:05.292552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10110): Terminating (SIGTERM) 13:24:05.332343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10113): Terminating (SIGTERM) 13:24:05.372270 --- ParallelTerminationStrategy: PID 10107 died... 13:24:05.391485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10107): Terminated: ok {rc=0} 13:24:05.435179 --- ParallelTerminationStrategy: PID 10110 died... 13:24:05.453818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10110): Terminated: ok {rc=0} 13:24:05.497527 --- ParallelTerminationStrategy: PID 10113 died... 13:24:05.516096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10113): Terminated: ok {rc=0} 13:24:05.600178 bus /sierra_3: Setting Powered False 13:24:06.697451 bus /sierra_3: Setting Powered False 13:24:07.814779 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:24:09.066697 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:24:09.073503 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:24:09.105872 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:24:09.132683 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:24:09.187795 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:24:09.222323 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:24:09.249502 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:24:09.794719 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:24:09.845105 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:24:09.856403 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:24:09.929170 tst mo_mt_call.py: using LAC 21755 13:24:10.050839 tst mo_mt_call.py: using RAC 80 13:24:10.171969 tst mo_mt_call.py: using CellId 21755 13:24:10.291368 tst mo_mt_call.py: using BVCI 21756 13:24:10.404031 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:24:10.415305 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:24:10.426534 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:24:10.437594 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:24:10.448641 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:24:10.459760 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:24:10.578098 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:24:10.696041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:11.173908 run create_hlr_db(pid=10119): Launched 13:24:11.301916 bus /sierra_2: Setting Powered False 13:24:12.363621 run create_hlr_db(pid=10119): Terminated: ok {rc=0} 13:24:12.812385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10121): Launched 13:24:13.142528 run osmo-hlr_10.42.42.2(pid=10122): Launched 13:24:13.268243 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:13.834220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10124): Launched 13:24:14.165170 run osmo-stp_10.42.42.5(pid=10125): Launched 13:24:14.291022 run osmo-msc_10.42.42.6: Starting osmo-msc 13:24:14.885839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10127): Launched 13:24:15.215576 run osmo-msc_10.42.42.6(pid=10128): Launched 13:24:15.399742 run osmo-stp_10.42.42.5(pid=10125): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10125)] 13:24:15.538035 run osmo-stp_10.42.42.5(pid=10125): stdout: | (launched: 2022-12-09_13:24:14.104474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:15.676348 run osmo-stp_10.42.42.5(pid=10125): stderr: | 20221209132414299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132414300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132414300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132414300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132414301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132414301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132414301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:15.814213 run osmo-stp_10.42.42.5(pid=10125): stdout: | (launched: 2022-12-09_13:24:14.104474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:15.974727 run osmo-stp_10.42.42.5(pid=10125): stderr: | 20221209132414299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132414300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132414300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132414300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132414301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132414301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132414301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:16.127205 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10125): Process ended prematurely: osmo-stp_10.42.42.5(pid=10125) [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10125)] [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:24:16.137748 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:24:16.167306 run osmo-hlr_10.42.42.2(pid=10122): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10122)] 13:24:16.218160 run osmo-hlr_10.42.42.2(pid=10122): stdout: | (launched: 2022-12-09_13:24:13.081366) 13:24:16.270514 run osmo-hlr_10.42.42.2(pid=10122): stderr: | 20221209132413284 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132413284 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132413284 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132413284 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132413284 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132413284 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132413296 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132413304 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132413305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132413305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:16.343674 run osmo-msc_10.42.42.6(pid=10128): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10128)] 13:24:16.394116 run osmo-msc_10.42.42.6(pid=10128): stdout: | (launched: 2022-12-09_13:24:15.155175) 13:24:16.446224 run osmo-msc_10.42.42.6(pid=10128): stderr: | 20221209132415478 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132415479 DLGLOBAL DEBUG validating counter group 0x7f9ce950ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132415479 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132415479 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132415479 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132415479 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132415481 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132415481 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132415481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132415481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:24:16.500011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10121): Terminating (SIGTERM) 13:24:16.543042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10124): Terminating (SIGTERM) 13:24:16.588601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10127): Terminating (SIGTERM) 13:24:16.633282 --- ParallelTerminationStrategy: PID 10121 died... 13:24:16.653383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10121): Terminated: ok {rc=0} 13:24:16.703702 --- ParallelTerminationStrategy: PID 10124 died... 13:24:16.723868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10124): Terminated: ok {rc=0} 13:24:16.771099 --- ParallelTerminationStrategy: PID 10127 died... 13:24:16.790980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10127): Terminated: ok {rc=0} 13:24:16.879561 bus /sierra_3: Setting Powered False 13:24:17.978599 bus /sierra_3: Setting Powered False 13:24:19.093728 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:24:20.245576 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:24:20.258078 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:24:20.330689 tst mo_mt_call_osmux.py: using LAC 21756 13:24:20.463526 tst mo_mt_call_osmux.py: using RAC 81 13:24:20.590907 tst mo_mt_call_osmux.py: using CellId 21756 13:24:20.717746 tst mo_mt_call_osmux.py: using BVCI 21757 13:24:20.837056 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:24:20.848803 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:24:20.860272 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:24:20.871849 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:24:20.883661 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:24:20.895458 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:24:21.012769 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:24:21.130787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:21.611379 run create_hlr_db(pid=10130): Launched 13:24:21.738244 bus /sierra_2: Setting Powered False 13:24:22.799814 run create_hlr_db(pid=10130): Terminated: ok {rc=0} 13:24:23.250925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10132): Launched 13:24:23.583731 run osmo-hlr_10.42.42.2(pid=10133): Launched 13:24:23.709764 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:24.276676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10135): Launched 13:24:24.606204 run osmo-stp_10.42.42.5(pid=10136): Launched 13:24:24.732447 run osmo-msc_10.42.42.6: Starting osmo-msc 13:24:25.327097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10138): Launched 13:24:25.658547 run osmo-msc_10.42.42.6(pid=10139): Launched 13:24:25.843605 run osmo-stp_10.42.42.5(pid=10136): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10136)] 13:24:25.982322 run osmo-stp_10.42.42.5(pid=10136): stdout: | (launched: 2022-12-09_13:24:24.545722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:26.122229 run osmo-stp_10.42.42.5(pid=10136): stderr: | 20221209132424739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132424739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132424739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132424740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132424742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132424742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132424742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:26.259460 run osmo-stp_10.42.42.5(pid=10136): stdout: | (launched: 2022-12-09_13:24:24.545722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:26.391005 run osmo-stp_10.42.42.5(pid=10136): stderr: | 20221209132424739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132424739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132424739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132424740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132424742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132424742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132424742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:26.547627 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10136): Process ended prematurely: osmo-stp_10.42.42.5(pid=10136) [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10136)] [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:24:26.557307 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:24:26.585338 run osmo-hlr_10.42.42.2(pid=10133): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10133)] 13:24:26.635897 run osmo-hlr_10.42.42.2(pid=10133): stdout: | (launched: 2022-12-09_13:24:23.522135) 13:24:26.687871 run osmo-hlr_10.42.42.2(pid=10133): stderr: | 20221209132423721 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132423721 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132423722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132423722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132423722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132423722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132423735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132423745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132423745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132423745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:26.760310 run osmo-msc_10.42.42.6(pid=10139): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10139)] 13:24:26.810458 run osmo-msc_10.42.42.6(pid=10139): stdout: | (launched: 2022-12-09_13:24:25.597880) 13:24:26.862596 run osmo-msc_10.42.42.6(pid=10139): stderr: | 20221209132425920 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132425921 DLGLOBAL DEBUG validating counter group 0x7fa086541c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132425921 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132425921 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132425921 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132425921 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132425923 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132425923 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132425923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132425924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:24:26.914766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10132): Terminating (SIGTERM) 13:24:26.957129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10135): Terminating (SIGTERM) 13:24:26.999354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10138): Terminating (SIGTERM) 13:24:27.041813 --- ParallelTerminationStrategy: PID 10132 died... 13:24:27.061891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10132): Terminated: ok {rc=0} 13:24:27.108654 --- ParallelTerminationStrategy: PID 10135 died... 13:24:27.128648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10135): Terminated: ok {rc=0} 13:24:27.175470 --- ParallelTerminationStrategy: PID 10138 died... 13:24:27.195097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10138): Terminated: ok {rc=0} 13:24:27.283704 bus /sierra_3: Setting Powered False 13:24:28.380818 bus /sierra_3: Setting Powered False 13:24:29.497180 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:24:30.752123 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:24:30.759056 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:24:30.792373 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:24:30.819104 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:24:30.877704 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:24:30.913952 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:24:30.950488 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:24:31.512726 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:24:31.592020 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:24:31.603681 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:24:31.674646 tst mo_mt_call.py: using LAC 21757 13:24:31.797654 tst mo_mt_call.py: using RAC 82 13:24:31.958690 tst mo_mt_call.py: using CellId 21757 13:24:32.082741 tst mo_mt_call.py: using BVCI 21758 13:24:32.255613 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:24:32.267528 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:24:32.279246 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:24:32.291030 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:24:32.302383 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:24:32.313729 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:24:32.433883 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:24:32.552235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:33.032648 run create_hlr_db(pid=10144): Launched 13:24:33.158640 bus /sierra_2: Setting Powered False 13:24:34.220565 run create_hlr_db(pid=10144): Terminated: ok {rc=0} 13:24:34.670557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10146): Launched 13:24:35.000365 run osmo-hlr_10.42.42.2(pid=10147): Launched 13:24:35.128398 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:35.695499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10149): Launched 13:24:36.026180 run osmo-stp_10.42.42.5(pid=10150): Launched 13:24:36.154113 run osmo-msc_10.42.42.6: Starting osmo-msc 13:24:36.749726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10152): Launched 13:24:37.079419 run osmo-msc_10.42.42.6(pid=10153): Launched 13:24:37.263460 run osmo-stp_10.42.42.5(pid=10150): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10150)] 13:24:37.403607 run osmo-stp_10.42.42.5(pid=10150): stdout: | (launched: 2022-12-09_13:24:35.965850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:37.543894 run osmo-stp_10.42.42.5(pid=10150): stderr: | 20221209132436158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132436158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132436158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132436159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132436161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132436161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132436161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:37.681659 run osmo-stp_10.42.42.5(pid=10150): stdout: | (launched: 2022-12-09_13:24:35.965850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:37.812882 run osmo-stp_10.42.42.5(pid=10150): stderr: | 20221209132436158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132436158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132436158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132436159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132436161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132436161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132436161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:37.969577 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10150): Process ended prematurely: osmo-stp_10.42.42.5(pid=10150) [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10150)] [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:24:37.979327 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 13:24:38.009364 run osmo-hlr_10.42.42.2(pid=10147): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10147)] 13:24:38.057356 run osmo-hlr_10.42.42.2(pid=10147): stdout: | (launched: 2022-12-09_13:24:34.939686) 13:24:38.107063 run osmo-hlr_10.42.42.2(pid=10147): stderr: | 20221209132435140 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132435140 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132435140 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132435140 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132435140 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132435140 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132435153 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132435161 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132435162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132435162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:38.175984 run osmo-msc_10.42.42.6(pid=10153): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10153)] 13:24:38.224043 run osmo-msc_10.42.42.6(pid=10153): stdout: | (launched: 2022-12-09_13:24:37.018699) 13:24:38.274212 run osmo-msc_10.42.42.6(pid=10153): stderr: | 20221209132437340 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132437340 DLGLOBAL DEBUG validating counter group 0x7f558e81dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132437340 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132437340 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132437340 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132437341 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132437342 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132437343 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132437343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132437343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:24:38.324053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10146): Terminating (SIGTERM) 13:24:38.363698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10149): Terminating (SIGTERM) 13:24:38.404560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10152): Terminating (SIGTERM) 13:24:38.444805 --- ParallelTerminationStrategy: PID 10146 died... 13:24:38.463776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10146): Terminated: ok {rc=0} 13:24:38.509028 --- ParallelTerminationStrategy: PID 10149 died... 13:24:38.527631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10149): Terminated: ok {rc=0} 13:24:38.572352 --- ParallelTerminationStrategy: PID 10152 died... 13:24:38.591156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10152): Terminated: ok {rc=0} 13:24:38.677262 bus /sierra_3: Setting Powered False 13:24:39.777205 bus /sierra_3: Setting Powered False 13:24:40.893093 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:24:42.041543 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:24:42.053398 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:24:42.124815 tst mo_mt_call_osmux.py: using LAC 21758 13:24:42.246674 tst mo_mt_call_osmux.py: using RAC 83 13:24:42.369012 tst mo_mt_call_osmux.py: using CellId 21758 13:24:42.491566 tst mo_mt_call_osmux.py: using BVCI 21759 13:24:42.605739 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:24:42.616661 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:24:42.627521 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:24:42.638294 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:24:42.649064 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:24:42.659903 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:24:42.778290 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:24:42.895399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:43.376179 run create_hlr_db(pid=10155): Launched 13:24:43.502355 bus /sierra_2: Setting Powered False 13:24:44.563703 run create_hlr_db(pid=10155): Terminated: ok {rc=0} 13:24:45.012211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10157): Launched 13:24:45.344170 run osmo-hlr_10.42.42.2(pid=10158): Launched 13:24:45.470147 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:46.066119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10160): Launched 13:24:46.403778 run osmo-stp_10.42.42.5(pid=10161): Launched 13:24:46.606025 run osmo-msc_10.42.42.6: Starting osmo-msc 13:24:47.463987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10163): Launched 13:24:47.798323 run osmo-msc_10.42.42.6(pid=10164): Launched 13:24:47.986270 run osmo-stp_10.42.42.5(pid=10161): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10161)] 13:24:48.125263 run osmo-stp_10.42.42.5(pid=10161): stdout: | (launched: 2022-12-09_13:24:46.342870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:48.264684 run osmo-stp_10.42.42.5(pid=10161): stderr: | 20221209132446736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132446738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132446739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132446741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132446742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132446742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132446742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:48.403829 run osmo-stp_10.42.42.5(pid=10161): stdout: | (launched: 2022-12-09_13:24:46.342870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:48.536148 run osmo-stp_10.42.42.5(pid=10161): stderr: | 20221209132446736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132446738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132446739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132446741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132446742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132446742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132446742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:48.694105 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10161): Process ended prematurely: osmo-stp_10.42.42.5(pid=10161) [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10161)] [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:24:48.703931 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 13:24:48.732804 run osmo-hlr_10.42.42.2(pid=10158): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10158)] 13:24:48.783484 run osmo-hlr_10.42.42.2(pid=10158): stdout: | (launched: 2022-12-09_13:24:45.283503) 13:24:48.835970 run osmo-hlr_10.42.42.2(pid=10158): stderr: | 20221209132445485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132445485 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132445485 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132445485 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132445486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132445486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132445496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132445504 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132445504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132445504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:48.909035 run osmo-msc_10.42.42.6(pid=10164): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10164)] 13:24:48.960097 run osmo-msc_10.42.42.6(pid=10164): stdout: | (launched: 2022-12-09_13:24:47.737428) 13:24:49.012376 run osmo-msc_10.42.42.6(pid=10164): stderr: | 20221209132448062 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132448062 DLGLOBAL DEBUG validating counter group 0x7fc419d0bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132448062 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132448062 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132448062 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132448063 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132448064 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132448065 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132448065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132448065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:24:49.065196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10157): Terminating (SIGTERM) 13:24:49.107765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10160): Terminating (SIGTERM) 13:24:49.150822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10163): Terminating (SIGTERM) 13:24:49.193773 --- ParallelTerminationStrategy: PID 10157 died... 13:24:49.213902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10157): Terminated: ok {rc=0} 13:24:49.260869 --- ParallelTerminationStrategy: PID 10160 died... 13:24:49.281152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10160): Terminated: ok {rc=0} 13:24:49.327930 --- ParallelTerminationStrategy: PID 10163 died... 13:24:49.347760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10163): Terminated: ok {rc=0} 13:24:49.436206 bus /sierra_3: Setting Powered False 13:24:50.535010 bus /sierra_3: Setting Powered False 13:24:51.649819 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:24:52.901644 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:24:52.907697 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:24:52.940414 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 13:24:52.967128 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 13:24:53.020388 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:24:53.052903 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 13:24:53.079331 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 13:24:53.629916 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 13:24:53.679394 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:24:53.691260 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:24:53.747950 tst mo_mt_call.py: using LAC 21759 13:24:53.867892 tst mo_mt_call.py: using RAC 84 13:24:53.987437 tst mo_mt_call.py: using CellId 21759 13:24:54.108305 tst mo_mt_call.py: using BVCI 21760 13:24:54.220244 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:24:54.231646 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:24:54.242822 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:24:54.253932 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:24:54.265076 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:24:54.276179 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:24:54.396318 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:24:54.515286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:54.994547 run create_hlr_db(pid=10169): Launched 13:24:55.122150 bus /sierra_2: Setting Powered False 13:24:56.183450 run create_hlr_db(pid=10169): Terminated: ok {rc=0} 13:24:56.633790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10171): Launched 13:24:56.963979 run osmo-hlr_10.42.42.2(pid=10172): Launched 13:24:57.090657 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:57.662105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10174): Launched 13:24:57.991873 run osmo-stp_10.42.42.5(pid=10175): Launched 13:24:58.119654 run osmo-msc_10.42.42.6: Starting osmo-msc 13:24:58.716199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10177): Launched 13:24:59.046602 run osmo-msc_10.42.42.6(pid=10178): Launched 13:24:59.231910 run osmo-stp_10.42.42.5(pid=10175): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10175)] 13:24:59.371211 run osmo-stp_10.42.42.5(pid=10175): stdout: | (launched: 2022-12-09_13:24:57.931484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:59.510683 run osmo-stp_10.42.42.5(pid=10175): stderr: | 20221209132458125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132458125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132458126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132458126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132458126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132458126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132458127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:59.649053 run osmo-stp_10.42.42.5(pid=10175): stdout: | (launched: 2022-12-09_13:24:57.931484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:59.780363 run osmo-stp_10.42.42.5(pid=10175): stderr: | 20221209132458125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132458125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132458126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132458126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132458126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132458126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132458127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:59.937290 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10175): Process ended prematurely: osmo-stp_10.42.42.5(pid=10175) [trial-2360↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10175)] [trial-2360↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 13:24:59.946914 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:24:59.975402 run osmo-hlr_10.42.42.2(pid=10172): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10172)] 13:25:00.025916 run osmo-hlr_10.42.42.2(pid=10172): stdout: | (launched: 2022-12-09_13:24:56.903608) 13:25:00.078081 run osmo-hlr_10.42.42.2(pid=10172): stderr: | 20221209132457102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132457102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132457102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132457102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132457102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132457102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132457115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132457125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132457125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132457125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:00.151183 run osmo-msc_10.42.42.6(pid=10178): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10178)] 13:25:00.201504 run osmo-msc_10.42.42.6(pid=10178): stdout: | (launched: 2022-12-09_13:24:58.985680) 13:25:00.253321 run osmo-msc_10.42.42.6(pid=10178): stderr: | 20221209132459310 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132459310 DLGLOBAL DEBUG validating counter group 0x7f7c080c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132459311 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132459311 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132459311 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132459311 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132459313 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132459313 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132459313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132459313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:25:00.305659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10171): Terminating (SIGTERM) 13:25:00.358571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10174): Terminating (SIGTERM) 13:25:00.400625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10177): Terminating (SIGTERM) 13:25:00.442764 --- ParallelTerminationStrategy: PID 10171 died... 13:25:00.462569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10171): Terminated: ok {rc=0} 13:25:00.508603 --- ParallelTerminationStrategy: PID 10174 died... 13:25:00.527975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10174): Terminated: ok {rc=0} 13:25:00.573669 --- ParallelTerminationStrategy: PID 10177 died... 13:25:00.592901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10177): Terminated: ok {rc=0} 13:25:00.680771 bus /sierra_3: Setting Powered False 13:25:01.778139 bus /sierra_3: Setting Powered False 13:25:02.907326 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 13:25:04.054714 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:25:04.067308 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:25:04.121563 tst mo_mt_call_osmux.py: using LAC 21760 13:25:04.241575 tst mo_mt_call_osmux.py: using RAC 85 13:25:04.361337 tst mo_mt_call_osmux.py: using CellId 21760 13:25:04.482341 tst mo_mt_call_osmux.py: using BVCI 21761 13:25:04.591844 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:25:04.603241 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:25:04.614435 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:25:04.626131 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:25:04.637976 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:25:04.649651 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:25:04.768748 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:25:04.886662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:05.353994 run create_hlr_db(pid=10183): Launched 13:25:05.477421 bus /sierra_2: Setting Powered False 13:25:06.536734 run create_hlr_db(pid=10183): Terminated: ok {rc=0} 13:25:06.975191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10185): Launched 13:25:07.297743 run osmo-hlr_10.42.42.2(pid=10186): Launched 13:25:07.420024 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:07.979301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10188): Launched 13:25:08.301946 run osmo-stp_10.42.42.5(pid=10189): Launched 13:25:08.425069 run osmo-msc_10.42.42.6: Starting osmo-msc 13:25:09.006924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10191): Launched 13:25:09.330119 run osmo-msc_10.42.42.6(pid=10192): Launched 13:25:09.509984 run osmo-stp_10.42.42.5(pid=10189): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10189)] 13:25:09.646493 run osmo-stp_10.42.42.5(pid=10189): stdout: | (launched: 2022-12-09_13:25:08.242635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:09.783116 run osmo-stp_10.42.42.5(pid=10189): stderr: | 20221209132508433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132508433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132508433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132508434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132508434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132508434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132508434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:09.919058 run osmo-stp_10.42.42.5(pid=10189): stdout: | (launched: 2022-12-09_13:25:08.242635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:10.047439 run osmo-stp_10.42.42.5(pid=10189): stderr: | 20221209132508433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132508433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132508433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132508434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132508434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132508434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132508434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:10.201737 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10189): Process ended prematurely: osmo-stp_10.42.42.5(pid=10189) [trial-2360↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10189)] [trial-2360↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 13:25:10.211457 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:25:10.239956 run osmo-hlr_10.42.42.2(pid=10186): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10186)] 13:25:10.290237 run osmo-hlr_10.42.42.2(pid=10186): stdout: | (launched: 2022-12-09_13:25:07.238595) 13:25:10.342021 run osmo-hlr_10.42.42.2(pid=10186): stderr: | 20221209132507436 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132507436 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132507436 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132507436 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132507436 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132507436 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132507451 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132507461 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132507462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132507462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:10.413905 run osmo-msc_10.42.42.6(pid=10192): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10192)] 13:25:10.463807 run osmo-msc_10.42.42.6(pid=10192): stdout: | (launched: 2022-12-09_13:25:09.270677) 13:25:10.515160 run osmo-msc_10.42.42.6(pid=10192): stderr: | 20221209132509591 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132509591 DLGLOBAL DEBUG validating counter group 0x7f7191f02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132509591 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132509591 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132509592 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132509592 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132509594 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132509594 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132509594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132509594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:25:10.567138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10185): Terminating (SIGTERM) 13:25:10.613414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10188): Terminating (SIGTERM) 13:25:10.655098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10191): Terminating (SIGTERM) 13:25:10.697050 --- ParallelTerminationStrategy: PID 10185 died... 13:25:10.716917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10185): Terminated: ok {rc=0} 13:25:10.763233 --- ParallelTerminationStrategy: PID 10188 died... 13:25:10.782821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10188): Terminated: ok {rc=0} 13:25:10.829119 --- ParallelTerminationStrategy: PID 10191 died... 13:25:10.848696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10191): Terminated: ok {rc=0} 13:25:10.935867 bus /sierra_3: Setting Powered False 13:25:12.034186 bus /sierra_3: Setting Powered False 13:25:13.150904 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 emergency:trx-umtrx --------------------------------------------------------------------- 13:25:14.399364 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:25:14.403674 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:25:14.436066 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 13:25:14.463000 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 13:25:14.547531 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:25:14.579951 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 13:25:14.606358 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 13:25:15.191287 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2360 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 13:25:15.196190 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:25:15.206944 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 13:25:15.254702 tst emergency_mo_mt_call.py: using LAC 21761 13:25:15.371415 tst emergency_mo_mt_call.py: using RAC 86 13:25:15.492229 tst emergency_mo_mt_call.py: using CellId 21761 13:25:15.606526 tst emergency_mo_mt_call.py: using BVCI 21762 13:25:15.714321 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:25:15.725044 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:25:15.735569 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:25:15.746107 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:25:15.756542 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:25:15.767005 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:25:15.908638 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:25:16.032272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:16.537589 run create_hlr_db(pid=10197): Launched 13:25:16.664512 bus /sierra_2: Setting Powered False 13:25:17.726222 run create_hlr_db(pid=10197): Terminated: ok {rc=0} 13:25:18.168531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10199): Launched 13:25:18.484409 run osmo-hlr_10.42.42.2(pid=10200): Launched 13:25:18.605583 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:19.149349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10202): Launched 13:25:19.464363 run osmo-stp_10.42.42.5(pid=10203): Launched 13:25:19.598687 tst emergency_mo_mt_call.py: using MSISDN 7230 13:25:19.763024 run osmo-msc_10.42.42.6: Starting osmo-msc 13:25:20.329920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10205): Launched 13:25:20.646515 run osmo-msc_10.42.42.6(pid=10206): Launched 13:25:20.822360 run osmo-stp_10.42.42.5(pid=10203): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10203)] 13:25:20.955461 run osmo-stp_10.42.42.5(pid=10203): stdout: | (launched: 2022-12-09_13:25:19.406570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:21.089875 run osmo-stp_10.42.42.5(pid=10203): stderr: | 20221209132519599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132519599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132519599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132519600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132519600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132519600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132519601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:21.224090 run osmo-stp_10.42.42.5(pid=10203): stdout: | (launched: 2022-12-09_13:25:19.406570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:21.350284 run osmo-stp_10.42.42.5(pid=10203): stderr: | 20221209132519599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132519599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132519599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132519600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132519600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132519600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132519601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:21.500868 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10203): Process ended prematurely: osmo-stp_10.42.42.5(pid=10203) [trial-2360↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10203)] [trial-2360↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 13:25:21.510015 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 13:25:21.538205 run osmo-hlr_10.42.42.2(pid=10200): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10200)] 13:25:21.588554 run osmo-hlr_10.42.42.2(pid=10200): stdout: | (launched: 2022-12-09_13:25:18.426124) 13:25:21.640533 run osmo-hlr_10.42.42.2(pid=10200): stderr: | 20221209132518622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132518622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132518622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132518622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132518622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132518622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132518635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132518643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132518643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132518643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:21.712839 run osmo-msc_10.42.42.6(pid=10206): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10206)] 13:25:21.763004 run osmo-msc_10.42.42.6(pid=10206): stdout: | (launched: 2022-12-09_13:25:20.588402) 13:25:21.814821 run osmo-msc_10.42.42.6(pid=10206): stderr: | 20221209132520912 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132520913 DLGLOBAL DEBUG validating counter group 0x7fe03df19c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132520913 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132520913 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132520913 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132520913 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132520915 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132520915 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132520916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132520916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:25:21.867443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10199): Terminating (SIGTERM) 13:25:21.909584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10202): Terminating (SIGTERM) 13:25:21.951848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10205): Terminating (SIGTERM) 13:25:21.994394 --- ParallelTerminationStrategy: PID 10199 died... 13:25:22.014511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10199): Terminated: ok {rc=0} 13:25:22.061002 --- ParallelTerminationStrategy: PID 10202 died... 13:25:22.080665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10202): Terminated: ok {rc=0} 13:25:22.127025 --- ParallelTerminationStrategy: PID 10205 died... 13:25:22.146867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10205): Terminated: ok {rc=0} 13:25:22.234199 bus /sierra_3: Setting Powered False 13:25:23.332238 bus /sierra_3: Setting Powered False 13:25:24.447992 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 13:25:25.531516 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:25:25.542983 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 13:25:25.597254 tst emergency_preemptive_call.py: using LAC 21762 13:25:25.711626 tst emergency_preemptive_call.py: using RAC 87 13:25:25.825337 tst emergency_preemptive_call.py: using CellId 21762 13:25:25.939257 tst emergency_preemptive_call.py: using BVCI 21763 13:25:26.045077 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:25:26.055663 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:25:26.066117 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:25:26.076409 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:25:26.086992 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:25:26.097442 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:25:26.208858 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:25:26.327310 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:25:26.442231 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:25:26.558846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:27.048372 run create_hlr_db(pid=10208): Launched 13:25:27.169813 bus /sierra_2: Setting Powered False 13:25:28.232633 run create_hlr_db(pid=10208): Terminated: ok {rc=0} 13:25:28.656400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10210): Launched 13:25:28.952319 run osmo-hlr_10.42.42.2(pid=10211): Launched 13:25:29.065212 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:29.572490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10213): Launched 13:25:29.866684 run osmo-stp_10.42.42.5(pid=10214): Launched 13:25:29.986133 tst emergency_preemptive_call.py: using MSISDN 7231 13:25:30.135722 run osmo-msc_10.42.42.6: Starting osmo-msc 13:25:30.664216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10216): Launched 13:25:30.994980 run osmo-msc_10.42.42.6(pid=10217): Launched 13:25:31.329355 run osmo-stp_10.42.42.5(pid=10214): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10214)] 13:25:31.548357 run osmo-stp_10.42.42.5(pid=10214): stdout: | (launched: 2022-12-09_13:25:29.811921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:31.790493 run osmo-stp_10.42.42.5(pid=10214): stderr: | 20221209132529982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132529982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132529982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132529982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132529983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132529984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132529984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:32.013810 run osmo-stp_10.42.42.5(pid=10214): stdout: | (launched: 2022-12-09_13:25:29.811921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:32.133705 run osmo-stp_10.42.42.5(pid=10214): stderr: | 20221209132529982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132529982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132529982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132529982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132529983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132529984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132529984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:32.278577 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10214): Process ended prematurely: osmo-stp_10.42.42.5(pid=10214) [trial-2360↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10214)] [trial-2360↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 13:25:32.286732 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 13:25:32.312333 run osmo-hlr_10.42.42.2(pid=10211): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10211)] 13:25:32.359495 run osmo-hlr_10.42.42.2(pid=10211): stdout: | (launched: 2022-12-09_13:25:28.898084) 13:25:32.408202 run osmo-hlr_10.42.42.2(pid=10211): stderr: | 20221209132529071 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132529071 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132529071 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132529071 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132529072 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132529072 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132529088 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132529098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132529098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132529098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:32.476481 run osmo-msc_10.42.42.6(pid=10217): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10217)] 13:25:32.523501 run osmo-msc_10.42.42.6(pid=10217): stdout: | (launched: 2022-12-09_13:25:30.925485) 13:25:32.572183 run osmo-msc_10.42.42.6(pid=10217): stderr: | 20221209132531520 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209132531520 DLGLOBAL DEBUG validating counter group 0x7ff9d8d65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209132531529 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209132531529 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209132531529 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209132531529 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209132531531 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209132531532 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209132531532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209132531532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:25:32.620913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10210): Terminating (SIGTERM) 13:25:32.660413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10213): Terminating (SIGTERM) 13:25:32.700106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10216): Terminating (SIGTERM) 13:25:32.739642 --- ParallelTerminationStrategy: PID 10210 died... 13:25:32.758686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10210): Terminated: ok {rc=0} 13:25:32.802253 --- ParallelTerminationStrategy: PID 10213 died... 13:25:32.820910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10213): Terminated: ok {rc=0} 13:25:32.864749 --- ParallelTerminationStrategy: PID 10216 died... 13:25:32.883315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10216): Terminated: ok {rc=0} 13:25:32.968081 bus /sierra_9: Setting Powered False 13:25:34.067873 bus /sierra_9: Setting Powered False 13:25:35.183228 bus /sierra_8: Setting Powered False 13:25:36.281304 bus /sierra_8: Setting Powered False 13:25:37.395565 bus /sierra_3: Setting Powered False 13:25:38.492746 bus /sierra_3: Setting Powered False 13:25:39.607453 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-umtrx --------------------------------------------------------------------- 13:25:40.883351 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:25:40.887613 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:25:40.919776 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 13:25:40.958209 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 13:25:41.043486 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:25:41.075335 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 13:25:41.113492 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 13:25:41.703992 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 13:25:41.752059 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:41.762555 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:25:41.809810 tst cs_paging_gprs_active.py: using LAC 21763 13:25:41.933317 tst cs_paging_gprs_active.py: using RAC 88 13:25:42.064396 tst cs_paging_gprs_active.py: using CellId 21763 13:25:42.195049 tst cs_paging_gprs_active.py: using BVCI 21764 13:25:42.312922 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:42.335027 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:42.346413 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:42.357374 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:42.368567 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:42.379871 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:42.391378 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:42.402662 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:42.414134 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:25:42.532181 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:25:42.645503 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:25:42.845386 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:43.142395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10225): Launched 13:25:43.398806 run iperf3-srv_10.42.42.10(pid=10226): Launched 13:25:43.509249 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:25:43.706681 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:44.001971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10227): Launched 13:25:44.258773 run iperf3-srv_10.42.42.10(pid=10228): Launched 13:25:44.369453 tst cs_paging_gprs_active.py:38: start network... 13:25:44.566609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:45.025618 run create_hlr_db(pid=10229): Launched 13:25:45.150336 bus /sierra_2: Setting Powered False 13:25:46.211937 run create_hlr_db(pid=10229): Terminated: ok {rc=0} 13:25:46.700347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10231): Launched 13:25:47.060305 run osmo-hlr_10.42.42.2(pid=10232): Launched 13:25:47.284372 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:47.800062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10234): Launched 13:25:48.093603 run osmo-stp_10.42.42.5(pid=10235): Launched 13:25:48.204581 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:25:48.711897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10237): Launched 13:25:48.825326 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:25:49.073666 run patchelf(pid=10238): Launched 13:25:49.240929 run osmo-stp_10.42.42.5(pid=10235): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10235)] 13:25:49.368286 run osmo-stp_10.42.42.5(pid=10235): stdout: | (launched: 2022-12-09_13:25:48.040314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:49.498360 run osmo-stp_10.42.42.5(pid=10235): stderr: | 20221209132548206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132548206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132548206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132548207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132548207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132548207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132548207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:49.627568 run osmo-stp_10.42.42.5(pid=10235): stdout: | (launched: 2022-12-09_13:25:48.040314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:49.751499 run osmo-stp_10.42.42.5(pid=10235): stderr: | 20221209132548206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132548206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132548206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132548207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132548207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132548207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132548207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:49.898081 run patchelf(pid=10238): Terminating (SIGINT) 13:25:50.066103 run patchelf(pid=10238): Terminated: ok {rc=0} 13:25:50.187636 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10235): Process ended prematurely: osmo-stp_10.42.42.5(pid=10235) [trial-2360↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10235)] [trial-2360↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 13:25:50.197020 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:25:50.224239 run osmo-hlr_10.42.42.2(pid=10232): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10232)] 13:25:50.272116 run osmo-hlr_10.42.42.2(pid=10232): stdout: | (launched: 2022-12-09_13:25:46.991125) 13:25:50.321687 run osmo-hlr_10.42.42.2(pid=10232): stderr: | 20221209132547239 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132547239 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132547240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132547240 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132547240 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132547240 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132547252 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132547260 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132547260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132547260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:50.371629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10225): Terminating (SIGTERM) 13:25:50.412077 run iperf3-srv_10.42.42.10(pid=10226): Terminating (SIGTERM) 13:25:50.452090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10227): Terminating (SIGTERM) 13:25:50.491900 run iperf3-srv_10.42.42.10(pid=10228): Terminating (SIGTERM) 13:25:50.531703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10231): Terminating (SIGTERM) 13:25:50.572208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10234): Terminating (SIGTERM) 13:25:50.612349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10237): Terminating (SIGTERM) 13:25:50.652649 --- ParallelTerminationStrategy: PID 10225 died... 13:25:50.671864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10225): Terminated: ok {rc=0} 13:25:50.716251 --- ParallelTerminationStrategy: PID 10226 died... 13:25:50.735187 run iperf3-srv_10.42.42.10(pid=10226): Terminated {rc=256} 13:25:50.779261 --- ParallelTerminationStrategy: PID 10227 died... 13:25:50.798522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10227): Terminated: ok {rc=0} 13:25:50.843220 --- ParallelTerminationStrategy: PID 10228 died... 13:25:50.861995 run iperf3-srv_10.42.42.10(pid=10228): Terminated {rc=256} 13:25:50.906887 --- ParallelTerminationStrategy: PID 10231 died... 13:25:50.925713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10231): Terminated: ok {rc=0} 13:25:50.969437 --- ParallelTerminationStrategy: PID 10234 died... 13:25:50.988037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10234): Terminated: ok {rc=0} 13:25:51.032716 --- ParallelTerminationStrategy: PID 10237 died... 13:25:51.051611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10237): Terminated: ok {rc=0} 13:25:51.135542 bus /gobi_0: Setting Powered False 13:25:52.234106 bus /gobi_0: Setting Powered False 13:25:53.351508 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx iperf3.py ---------------------------------------------- 13:25:54.502196 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:54.513267 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:25:54.563825 tst iperf3.py: using LAC 21764 13:25:54.683132 tst iperf3.py: using RAC 89 13:25:54.807465 tst iperf3.py: using CellId 21764 13:25:54.927333 tst iperf3.py: using BVCI 21765 13:25:55.037781 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:55.048546 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:55.059002 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:55.069341 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:55.079569 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:55.089857 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:55.100237 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:55.110641 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:25:55.121126 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:25:55.235020 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:25:55.437428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:55.740091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10239): Launched 13:25:56.002124 run iperf3-srv_10.42.42.10(pid=10240): Launched 13:25:56.114839 tst iperf3.py:8: start network... 13:25:56.316022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:56.781712 run create_hlr_db(pid=10241): Launched 13:25:56.905446 bus /gobi_6: Setting Powered False 13:25:57.965791 run create_hlr_db(pid=10241): Terminated: ok {rc=0} 13:25:58.406286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10243): Launched 13:25:58.729401 run osmo-hlr_10.42.42.2(pid=10244): Launched 13:25:58.852448 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:59.411145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10246): Launched 13:25:59.731757 run osmo-stp_10.42.42.5(pid=10247): Launched 13:25:59.854508 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:00.408899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10249): Launched 13:26:00.531761 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:00.803266 run patchelf(pid=10250): Launched 13:26:01.000691 run osmo-stp_10.42.42.5(pid=10247): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10247)] 13:26:01.141395 run osmo-stp_10.42.42.5(pid=10247): stdout: | (launched: 2022-12-09_13:25:59.673629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:01.286392 run osmo-stp_10.42.42.5(pid=10247): stderr: | 20221209132559861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132559861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132559861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132559862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132559862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132559862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132559862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:01.427896 run osmo-stp_10.42.42.5(pid=10247): stdout: | (launched: 2022-12-09_13:25:59.673629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:01.564214 run osmo-stp_10.42.42.5(pid=10247): stderr: | 20221209132559861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132559861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132559861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132559862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132559862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132559862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132559862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:01.724904 run patchelf(pid=10250): Terminating (SIGINT) 13:26:01.909176 run patchelf(pid=10250): Terminated: ok {rc=0} 13:26:02.042093 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10247): Process ended prematurely: osmo-stp_10.42.42.5(pid=10247) [trial-2360↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10247)] [trial-2360↪gprs:trx-umtrx↪iperf3.py:8] 13:26:02.052921 tst iperf3.py:8: Test FAILED (7.6 sec) 13:26:02.084837 run osmo-hlr_10.42.42.2(pid=10244): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10244)] 13:26:02.137781 run osmo-hlr_10.42.42.2(pid=10244): stdout: | (launched: 2022-12-09_13:25:58.671188) 13:26:02.191497 run osmo-hlr_10.42.42.2(pid=10244): stderr: | 20221209132558866 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132558866 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132558866 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132558866 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132558866 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132558866 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132558879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132558889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132558890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132558890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:02.244395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10239): Terminating (SIGTERM) 13:26:02.286838 run iperf3-srv_10.42.42.10(pid=10240): Terminating (SIGTERM) 13:26:02.329379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10243): Terminating (SIGTERM) 13:26:02.371711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10246): Terminating (SIGTERM) 13:26:02.413932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10249): Terminating (SIGTERM) 13:26:02.456344 --- ParallelTerminationStrategy: PID 10239 died... 13:26:02.476500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10239): Terminated: ok {rc=0} 13:26:02.523503 --- ParallelTerminationStrategy: PID 10240 died... 13:26:02.543241 run iperf3-srv_10.42.42.10(pid=10240): Terminated {rc=256} 13:26:02.589840 --- ParallelTerminationStrategy: PID 10243 died... 13:26:02.609503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10243): Terminated: ok {rc=0} 13:26:02.656167 --- ParallelTerminationStrategy: PID 10246 died... 13:26:02.675879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10246): Terminated: ok {rc=0} 13:26:02.722473 --- ParallelTerminationStrategy: PID 10249 died... 13:26:02.742154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10249): Terminated: ok {rc=0} 13:26:02.830735 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 13:26:03.978368 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:03.990245 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:26:04.040198 tst iperf3m4.py: using LAC 21765 13:26:04.168309 tst iperf3m4.py: using RAC 90 13:26:04.297774 tst iperf3m4.py: using CellId 21765 13:26:04.427797 tst iperf3m4.py: using BVCI 21766 13:26:04.547194 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:04.558463 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:04.569284 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:04.580182 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:04.591178 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:04.602299 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:04.613951 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:04.624910 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:04.636175 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:26:04.757700 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:26:04.883848 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:26:05.000782 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:26:05.117672 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:26:05.321309 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:05.625113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10251): Launched 13:26:05.888390 run iperf3-srv_10.42.42.10(pid=10252): Launched 13:26:06.001706 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:26:06.203329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:06.504721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10253): Launched 13:26:06.767462 run iperf3-srv_10.42.42.10(pid=10254): Launched 13:26:06.881265 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:26:07.083856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:07.386650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10255): Launched 13:26:07.649252 run iperf3-srv_10.42.42.10(pid=10256): Launched 13:26:07.762827 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:26:07.964674 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:08.267962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10257): Launched 13:26:08.531123 run iperf3-srv_10.42.42.10(pid=10258): Launched 13:26:08.644536 tst iperf3m4.py:8: start network... 13:26:08.846336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:09.315774 run create_hlr_db(pid=10259): Launched 13:26:09.440416 bus /gobi_6: Setting Powered False 13:26:10.501074 run create_hlr_db(pid=10259): Terminated: ok {rc=0} 13:26:10.920801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10261): Launched 13:26:11.224156 run osmo-hlr_10.42.42.2(pid=10262): Launched 13:26:11.338229 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:11.874364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10264): Launched 13:26:12.176290 run osmo-stp_10.42.42.5(pid=10265): Launched 13:26:12.291279 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:12.810949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10267): Launched 13:26:12.925976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:13.181929 run patchelf(pid=10268): Launched 13:26:13.349105 run osmo-stp_10.42.42.5(pid=10265): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10265)] 13:26:13.476832 run osmo-stp_10.42.42.5(pid=10265): stdout: | (launched: 2022-12-09_13:26:12.120927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:13.606018 run osmo-stp_10.42.42.5(pid=10265): stderr: | 20221209132612288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132612288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132612288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132612289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132612289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132612289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132612289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:13.735742 run osmo-stp_10.42.42.5(pid=10265): stdout: | (launched: 2022-12-09_13:26:12.120927) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:13.859511 run osmo-stp_10.42.42.5(pid=10265): stderr: | 20221209132612288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132612288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132612288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132612289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132612289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132612289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132612289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:14.006680 run patchelf(pid=10268): Terminating (SIGINT) 13:26:14.175583 run patchelf(pid=10268): Terminated: ok {rc=0} 13:26:14.296751 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10265): Process ended prematurely: osmo-stp_10.42.42.5(pid=10265) [trial-2360↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10265)] [trial-2360↪gprs:trx-umtrx↪iperf3m4.py:8] 13:26:14.306227 tst iperf3m4.py:8: Test FAILED (10.4 sec) 13:26:14.333295 run osmo-hlr_10.42.42.2(pid=10262): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10262)] 13:26:14.380294 run osmo-hlr_10.42.42.2(pid=10262): stdout: | (launched: 2022-12-09_13:26:11.168793) 13:26:14.429248 run osmo-hlr_10.42.42.2(pid=10262): stderr: | 20221209132611343 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132611343 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132611343 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132611343 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132611343 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132611343 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132611356 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132611365 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132611365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132611365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:14.478420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10251): Terminating (SIGTERM) 13:26:14.517836 run iperf3-srv_10.42.42.10(pid=10252): Terminating (SIGTERM) 13:26:14.557239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10253): Terminating (SIGTERM) 13:26:14.596630 run iperf3-srv_10.42.42.10(pid=10254): Terminating (SIGTERM) 13:26:14.635994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10255): Terminating (SIGTERM) 13:26:14.675558 run iperf3-srv_10.42.42.10(pid=10256): Terminating (SIGTERM) 13:26:14.714745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10257): Terminating (SIGTERM) 13:26:14.754049 run iperf3-srv_10.42.42.10(pid=10258): Terminating (SIGTERM) 13:26:14.793321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10261): Terminating (SIGTERM) 13:26:14.833318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10264): Terminating (SIGTERM) 13:26:14.872646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10267): Terminating (SIGTERM) 13:26:14.912143 --- ParallelTerminationStrategy: PID 10251 died... 13:26:14.931218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10251): Terminated: ok {rc=0} 13:26:14.974858 --- ParallelTerminationStrategy: PID 10252 died... 13:26:14.993850 run iperf3-srv_10.42.42.10(pid=10252): Terminated {rc=256} 13:26:15.037869 --- ParallelTerminationStrategy: PID 10253 died... 13:26:15.056493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10253): Terminated: ok {rc=0} 13:26:15.100060 --- ParallelTerminationStrategy: PID 10254 died... 13:26:15.118545 run iperf3-srv_10.42.42.10(pid=10254): Terminated {rc=256} 13:26:15.162692 --- ParallelTerminationStrategy: PID 10255 died... 13:26:15.181378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10255): Terminated: ok {rc=0} 13:26:15.224847 --- ParallelTerminationStrategy: PID 10256 died... 13:26:15.243762 run iperf3-srv_10.42.42.10(pid=10256): Terminated {rc=256} 13:26:15.287411 --- ParallelTerminationStrategy: PID 10257 died... 13:26:15.306055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10257): Terminated: ok {rc=0} 13:26:15.349743 --- ParallelTerminationStrategy: PID 10258 died... 13:26:15.368154 run iperf3-srv_10.42.42.10(pid=10258): Terminated {rc=256} 13:26:15.411851 --- ParallelTerminationStrategy: PID 10261 died... 13:26:15.430576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10261): Terminated: ok {rc=0} 13:26:15.474359 --- ParallelTerminationStrategy: PID 10264 died... 13:26:15.493179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10264): Terminated: ok {rc=0} 13:26:15.536825 --- ParallelTerminationStrategy: PID 10267 died... 13:26:15.555495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10267): Terminated: ok {rc=0} 13:26:15.638865 bus /gobi_4: Setting Powered False 13:26:16.741415 bus /gobi_4: Setting Powered False 13:26:17.865362 bus /gobi_1: Setting Powered False 13:26:18.961254 bus /gobi_1: Setting Powered False 13:26:20.075846 bus /gobi_0: Setting Powered False 13:26:21.174036 bus /gobi_0: Setting Powered False 13:26:22.291110 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx ping.py ---------------------------------------------- 13:26:23.391929 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:23.403160 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:26:23.451913 tst ping.py: using LAC 21766 13:26:23.570593 tst ping.py: using RAC 91 13:26:23.688811 tst ping.py: using CellId 21766 13:26:23.804940 tst ping.py: using BVCI 21767 13:26:23.912344 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:23.922892 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:23.933236 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:23.943502 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:23.953726 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:23.963944 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:23.974444 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:23.984703 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:26:24.101595 tst ping.py:19: start network... 13:26:24.316212 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:24.808201 run create_hlr_db(pid=10269): Launched 13:26:24.929035 bus /gobi_6: Setting Powered False 13:26:25.991862 run create_hlr_db(pid=10269): Terminated: ok {rc=0} 13:26:26.417710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10271): Launched 13:26:26.713902 run osmo-hlr_10.42.42.2(pid=10272): Launched 13:26:26.826296 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:27.344403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10274): Launched 13:26:27.640878 run osmo-stp_10.42.42.5(pid=10275): Launched 13:26:27.753470 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:28.265559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10277): Launched 13:26:28.379242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:28.629420 run patchelf(pid=10278): Launched 13:26:28.794081 run osmo-stp_10.42.42.5(pid=10275): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10275)] 13:26:28.920106 run osmo-stp_10.42.42.5(pid=10275): stdout: | (launched: 2022-12-09_13:26:27.586381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:29.047719 run osmo-stp_10.42.42.5(pid=10275): stderr: | 20221209132627757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132627757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132627758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132627758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132627759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132627759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132627759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:29.176018 run osmo-stp_10.42.42.5(pid=10275): stdout: | (launched: 2022-12-09_13:26:27.586381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:29.297873 run osmo-stp_10.42.42.5(pid=10275): stderr: | 20221209132627757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132627757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132627758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132627758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132627759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132627759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132627759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:29.442307 run patchelf(pid=10278): Terminating (SIGINT) 13:26:29.608885 run patchelf(pid=10278): Terminated: ok {rc=0} 13:26:29.728643 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10275): Process ended prematurely: osmo-stp_10.42.42.5(pid=10275) [trial-2360↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10275)] [trial-2360↪gprs:trx-umtrx↪ping.py:22] 13:26:29.737495 tst ping.py:22: Test FAILED (6.3 sec) 13:26:29.764112 run osmo-hlr_10.42.42.2(pid=10272): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10272)] 13:26:29.811416 run osmo-hlr_10.42.42.2(pid=10272): stdout: | (launched: 2022-12-09_13:26:26.659573) 13:26:29.860365 run osmo-hlr_10.42.42.2(pid=10272): stderr: | 20221209132626833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132626833 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132626833 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132626833 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132626833 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132626833 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132626846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132626855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132626855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132626855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:29.909757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10271): Terminating (SIGTERM) 13:26:29.949329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10274): Terminating (SIGTERM) 13:26:29.988546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10277): Terminating (SIGTERM) 13:26:30.027979 --- ParallelTerminationStrategy: PID 10271 died... 13:26:30.046996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10271): Terminated: ok {rc=0} 13:26:30.090630 --- ParallelTerminationStrategy: PID 10274 died... 13:26:30.109679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10274): Terminated: ok {rc=0} 13:26:30.153465 --- ParallelTerminationStrategy: PID 10277 died... 13:26:30.172095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10277): Terminated: ok {rc=0} 13:26:30.254783 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 13:26:31.347957 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:31.362305 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:26:31.421416 tst ping_idle_ping.py: using LAC 21767 13:26:31.565390 tst ping_idle_ping.py: using RAC 92 13:26:31.722374 tst ping_idle_ping.py: using CellId 21767 13:26:31.843928 tst ping_idle_ping.py: using BVCI 21768 13:26:31.956740 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:31.967956 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:31.979072 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:31.990645 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:32.001875 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:32.012768 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:32.023916 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:26:32.035063 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:26:32.150459 tst ping_idle_ping.py:24: start network... 13:26:32.394213 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:32.858507 run create_hlr_db(pid=10279): Launched 13:26:32.984340 bus /gobi_6: Setting Powered False 13:26:34.048465 run create_hlr_db(pid=10279): Terminated: ok {rc=0} 13:26:34.478382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10281): Launched 13:26:34.778308 run osmo-hlr_10.42.42.2(pid=10282): Launched 13:26:34.892088 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:35.405900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10284): Launched 13:26:35.703704 run osmo-stp_10.42.42.5(pid=10285): Launched 13:26:35.817836 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:36.331342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10287): Launched 13:26:36.444294 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:36.695736 run patchelf(pid=10288): Launched 13:26:36.861148 run osmo-stp_10.42.42.5(pid=10285): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10285)] 13:26:36.987043 run osmo-stp_10.42.42.5(pid=10285): stdout: | (launched: 2022-12-09_13:26:35.648820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:37.115331 run osmo-stp_10.42.42.5(pid=10285): stderr: | 20221209132635818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132635818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132635818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132635818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132635819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132635819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132635819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:37.243532 run osmo-stp_10.42.42.5(pid=10285): stdout: | (launched: 2022-12-09_13:26:35.648820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:37.365338 run osmo-stp_10.42.42.5(pid=10285): stderr: | 20221209132635818 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132635818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132635818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132635818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132635819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132635819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132635819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:37.509801 run patchelf(pid=10288): Terminating (SIGINT) 13:26:37.676315 run patchelf(pid=10288): Terminated: ok {rc=0} 13:26:37.796315 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10285): Process ended prematurely: osmo-stp_10.42.42.5(pid=10285) [trial-2360↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10285)] [trial-2360↪gprs:trx-umtrx↪ping_idle_ping.py:27] 13:26:37.805306 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:26:37.831861 run osmo-hlr_10.42.42.2(pid=10282): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10282)] 13:26:37.879391 run osmo-hlr_10.42.42.2(pid=10282): stdout: | (launched: 2022-12-09_13:26:34.723280) 13:26:37.928748 run osmo-hlr_10.42.42.2(pid=10282): stderr: | 20221209132634896 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132634896 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132634897 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132634897 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132634897 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132634897 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132634914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132634924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132634925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132634925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:37.978540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10281): Terminating (SIGTERM) 13:26:38.018331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10284): Terminating (SIGTERM) 13:26:38.058069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10287): Terminating (SIGTERM) 13:26:38.098083 --- ParallelTerminationStrategy: PID 10281 died... 13:26:38.117408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10281): Terminated: ok {rc=0} 13:26:38.161545 --- ParallelTerminationStrategy: PID 10284 died... 13:26:38.180297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10284): Terminated: ok {rc=0} 13:26:38.224342 --- ParallelTerminationStrategy: PID 10287 died... 13:26:38.243110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10287): Terminated: ok {rc=0} 13:26:38.329053 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 13:26:39.631478 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:26:39.636548 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:26:39.668792 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:26:39.707212 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:26:39.793904 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:26:39.825992 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:26:39.863999 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:26:40.455320 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:26:40.503933 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:40.514805 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:26:40.564693 tst cs_paging_gprs_active.py: using LAC 21768 13:26:40.685374 tst cs_paging_gprs_active.py: using RAC 93 13:26:40.805268 tst cs_paging_gprs_active.py: using CellId 21768 13:26:40.925926 tst cs_paging_gprs_active.py: using BVCI 21769 13:26:41.036466 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:41.047447 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:41.058123 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:41.068669 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:41.079338 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:41.089943 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:41.100721 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:41.111269 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:41.122049 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:26:41.240225 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:26:41.357421 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:26:41.561602 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:41.866306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10294): Launched 13:26:42.132014 run iperf3-srv_10.42.42.10(pid=10295): Launched 13:26:42.245956 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:26:42.448539 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:42.752286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10296): Launched 13:26:43.015361 run iperf3-srv_10.42.42.10(pid=10297): Launched 13:26:43.128842 tst cs_paging_gprs_active.py:38: start network... 13:26:43.332267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:43.801326 run create_hlr_db(pid=10298): Launched 13:26:43.925291 bus /gobi_6: Setting Powered False 13:26:44.986244 run create_hlr_db(pid=10298): Terminated: ok {rc=0} 13:26:45.430688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10300): Launched 13:26:45.756225 run osmo-hlr_10.42.42.2(pid=10301): Launched 13:26:45.942801 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:46.602001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10303): Launched 13:26:46.940049 run osmo-stp_10.42.42.5(pid=10304): Launched 13:26:47.155324 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:47.722118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10306): Launched 13:26:47.837227 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:48.091973 run patchelf(pid=10307): Launched 13:26:48.259880 run osmo-stp_10.42.42.5(pid=10304): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10304)] 13:26:48.388210 run osmo-stp_10.42.42.5(pid=10304): stdout: | (launched: 2022-12-09_13:26:46.881383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:48.517799 run osmo-stp_10.42.42.5(pid=10304): stderr: | 20221209132647184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132647184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132647189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132647189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132647197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132647197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132647197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:48.647161 run osmo-stp_10.42.42.5(pid=10304): stdout: | (launched: 2022-12-09_13:26:46.881383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:48.771105 run osmo-stp_10.42.42.5(pid=10304): stderr: | 20221209132647184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132647184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132647189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132647189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132647197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132647197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132647197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:48.917986 run patchelf(pid=10307): Terminating (SIGINT) 13:26:49.087013 run patchelf(pid=10307): Terminated: ok {rc=0} 13:26:49.209318 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10304): Process ended prematurely: osmo-stp_10.42.42.5(pid=10304) [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10304)] [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:26:49.218669 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:26:49.245712 run osmo-hlr_10.42.42.2(pid=10301): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10301)] 13:26:49.293462 run osmo-hlr_10.42.42.2(pid=10301): stdout: | (launched: 2022-12-09_13:26:45.697526) 13:26:49.342409 run osmo-hlr_10.42.42.2(pid=10301): stderr: | 20221209132645900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132645900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132645900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132645900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132645900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132645900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132645919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132645945 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132645945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132645945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:49.391894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10294): Terminating (SIGTERM) 13:26:49.431454 run iperf3-srv_10.42.42.10(pid=10295): Terminating (SIGTERM) 13:26:49.470850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10296): Terminating (SIGTERM) 13:26:49.510262 run iperf3-srv_10.42.42.10(pid=10297): Terminating (SIGTERM) 13:26:49.549552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10300): Terminating (SIGTERM) 13:26:49.589298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10303): Terminating (SIGTERM) 13:26:49.629209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10306): Terminating (SIGTERM) 13:26:49.669188 --- ParallelTerminationStrategy: PID 10294 died... 13:26:49.688152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10294): Terminated: ok {rc=0} 13:26:49.731687 --- ParallelTerminationStrategy: PID 10295 died... 13:26:49.750125 run iperf3-srv_10.42.42.10(pid=10295): Terminated {rc=256} 13:26:49.793336 --- ParallelTerminationStrategy: PID 10296 died... 13:26:49.811851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10296): Terminated: ok {rc=0} 13:26:49.855173 --- ParallelTerminationStrategy: PID 10297 died... 13:26:49.873655 run iperf3-srv_10.42.42.10(pid=10297): Terminated {rc=256} 13:26:49.917020 --- ParallelTerminationStrategy: PID 10300 died... 13:26:49.935566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10300): Terminated: ok {rc=0} 13:26:49.979105 --- ParallelTerminationStrategy: PID 10303 died... 13:26:49.997719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10303): Terminated: ok {rc=0} 13:26:50.041111 --- ParallelTerminationStrategy: PID 10306 died... 13:26:50.059660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10306): Terminated: ok {rc=0} 13:26:50.145583 bus /gobi_0: Setting Powered False 13:26:51.244579 bus /gobi_0: Setting Powered False 13:26:52.360713 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:26:53.506521 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:53.517984 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:26:53.570002 tst iperf3.py: using LAC 21769 13:26:53.699167 tst iperf3.py: using RAC 94 13:26:53.826282 tst iperf3.py: using CellId 21769 13:26:53.955877 tst iperf3.py: using BVCI 21770 13:26:54.076533 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:54.088039 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:54.099278 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:54.111109 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:54.122777 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:54.134439 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:54.146383 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:54.157875 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:54.169642 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:26:54.285928 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:26:54.488056 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:54.791150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10308): Launched 13:26:55.053518 run iperf3-srv_10.42.42.10(pid=10309): Launched 13:26:55.166903 tst iperf3.py:8: start network... 13:26:55.369856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:55.837377 run create_hlr_db(pid=10310): Launched 13:26:55.959908 bus /gobi_6: Setting Powered False 13:26:57.019866 run create_hlr_db(pid=10310): Terminated: ok {rc=0} 13:26:57.439308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10312): Launched 13:26:57.739781 run osmo-hlr_10.42.42.2(pid=10313): Launched 13:26:57.854442 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:58.384329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10315): Launched 13:26:58.685795 run osmo-stp_10.42.42.5(pid=10316): Launched 13:26:58.801568 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:59.321347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10318): Launched 13:26:59.437258 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:59.691650 run patchelf(pid=10319): Launched 13:26:59.859237 run osmo-stp_10.42.42.5(pid=10316): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10316)] 13:26:59.986165 run osmo-stp_10.42.42.5(pid=10316): stdout: | (launched: 2022-12-09_13:26:58.630534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:00.114860 run osmo-stp_10.42.42.5(pid=10316): stderr: | 20221209132658801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132658801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132658802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132658802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132658802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132658802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132658803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:00.244186 run osmo-stp_10.42.42.5(pid=10316): stdout: | (launched: 2022-12-09_13:26:58.630534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:00.367405 run osmo-stp_10.42.42.5(pid=10316): stderr: | 20221209132658801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132658801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132658802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132658802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132658802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132658802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132658803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:00.513464 run patchelf(pid=10319): Terminating (SIGINT) 13:27:00.681784 run patchelf(pid=10319): Terminated: ok {rc=0} 13:27:00.802959 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10316): Process ended prematurely: osmo-stp_10.42.42.5(pid=10316) [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10316)] [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 13:27:00.812320 tst iperf3.py:8: Test FAILED (7.3 sec) 13:27:00.851776 run osmo-hlr_10.42.42.2(pid=10313): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10313)] 13:27:00.915713 run osmo-hlr_10.42.42.2(pid=10313): stdout: | (launched: 2022-12-09_13:26:57.684327) 13:27:00.966317 run osmo-hlr_10.42.42.2(pid=10313): stderr: | 20221209132657857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132657857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132657857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132657858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132657858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132657858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132657873 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132657882 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132657882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132657882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:01.017458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10308): Terminating (SIGTERM) 13:27:01.057599 run iperf3-srv_10.42.42.10(pid=10309): Terminating (SIGTERM) 13:27:01.099103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10312): Terminating (SIGTERM) 13:27:01.140100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10315): Terminating (SIGTERM) 13:27:01.180382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10318): Terminating (SIGTERM) 13:27:01.221206 --- ParallelTerminationStrategy: PID 10308 died... 13:27:01.240471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10308): Terminated: ok {rc=0} 13:27:01.287124 --- ParallelTerminationStrategy: PID 10309 died... 13:27:01.306521 run iperf3-srv_10.42.42.10(pid=10309): Terminated {rc=256} 13:27:01.350852 --- ParallelTerminationStrategy: PID 10312 died... 13:27:01.371072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10312): Terminated: ok {rc=0} 13:27:01.417129 --- ParallelTerminationStrategy: PID 10315 died... 13:27:01.437334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10315): Terminated: ok {rc=0} 13:27:01.483417 --- ParallelTerminationStrategy: PID 10318 died... 13:27:01.502927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10318): Terminated: ok {rc=0} 13:27:01.594219 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:27:02.751390 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:02.762859 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:27:02.813509 tst iperf3m4.py: using LAC 21770 13:27:02.933714 tst iperf3m4.py: using RAC 95 13:27:03.053139 tst iperf3m4.py: using CellId 21770 13:27:03.173372 tst iperf3m4.py: using BVCI 21771 13:27:03.283292 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:03.294225 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:03.304843 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:03.315675 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:03.326357 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:03.336813 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:03.347537 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:03.358034 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:03.368725 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:27:03.484917 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:27:03.607159 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:27:03.728388 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:27:03.847839 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:27:04.067205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:04.392532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10320): Launched 13:27:04.673991 run iperf3-srv_10.42.42.10(pid=10321): Launched 13:27:04.797623 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:27:05.015346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:05.341369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10322): Launched 13:27:05.623055 run iperf3-srv_10.42.42.10(pid=10323): Launched 13:27:05.744755 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:27:05.963438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:06.289237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10324): Launched 13:27:06.571501 run iperf3-srv_10.42.42.10(pid=10325): Launched 13:27:06.693298 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:27:06.911445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:07.237123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10326): Launched 13:27:07.519652 run iperf3-srv_10.42.42.10(pid=10327): Launched 13:27:07.641234 tst iperf3m4.py:8: start network... 13:27:07.859315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:08.361778 run create_hlr_db(pid=10328): Launched 13:27:08.486324 bus /gobi_6: Setting Powered False 13:27:09.546404 run create_hlr_db(pid=10328): Terminated: ok {rc=0} 13:27:09.977074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10330): Launched 13:27:10.278895 run osmo-hlr_10.42.42.2(pid=10331): Launched 13:27:10.394474 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:10.916010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10333): Launched 13:27:11.219146 run osmo-stp_10.42.42.5(pid=10334): Launched 13:27:11.335739 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:27:11.859766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10336): Launched 13:27:11.975382 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:27:12.231324 run patchelf(pid=10337): Launched 13:27:12.400458 run osmo-stp_10.42.42.5(pid=10334): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10334)] 13:27:12.528467 run osmo-stp_10.42.42.5(pid=10334): stdout: | (launched: 2022-12-09_13:27:11.163245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:12.658005 run osmo-stp_10.42.42.5(pid=10334): stderr: | 20221209132711331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132711331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132711332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132711332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132711333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132711333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132711333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:12.787746 run osmo-stp_10.42.42.5(pid=10334): stdout: | (launched: 2022-12-09_13:27:11.163245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:12.912173 run osmo-stp_10.42.42.5(pid=10334): stderr: | 20221209132711331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132711331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132711332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132711332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132711333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132711333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132711333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:13.071963 run patchelf(pid=10337): Terminating (SIGINT) 13:27:13.254617 run patchelf(pid=10337): Terminated: ok {rc=0} 13:27:13.385694 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10334): Process ended prematurely: osmo-stp_10.42.42.5(pid=10334) [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10334)] [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 13:27:13.395949 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:27:13.425838 run osmo-hlr_10.42.42.2(pid=10331): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10331)] 13:27:13.477260 run osmo-hlr_10.42.42.2(pid=10331): stdout: | (launched: 2022-12-09_13:27:10.223411) 13:27:13.529950 run osmo-hlr_10.42.42.2(pid=10331): stderr: | 20221209132710398 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132710398 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132710398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132710398 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132710398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132710399 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132710410 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132710420 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132710420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132710420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:13.583061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10320): Terminating (SIGTERM) 13:27:13.625677 run iperf3-srv_10.42.42.10(pid=10321): Terminating (SIGTERM) 13:27:13.668359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10322): Terminating (SIGTERM) 13:27:13.710985 run iperf3-srv_10.42.42.10(pid=10323): Terminating (SIGTERM) 13:27:13.753490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10324): Terminating (SIGTERM) 13:27:13.796109 run iperf3-srv_10.42.42.10(pid=10325): Terminating (SIGTERM) 13:27:13.838477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10326): Terminating (SIGTERM) 13:27:13.880817 run iperf3-srv_10.42.42.10(pid=10327): Terminating (SIGTERM) 13:27:13.923226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10330): Terminating (SIGTERM) 13:27:13.965960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10333): Terminating (SIGTERM) 13:27:14.008412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10336): Terminating (SIGTERM) 13:27:14.051264 --- ParallelTerminationStrategy: PID 10320 died... 13:27:14.071623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10320): Terminated: ok {rc=0} 13:27:14.118883 --- ParallelTerminationStrategy: PID 10321 died... 13:27:14.138581 run iperf3-srv_10.42.42.10(pid=10321): Terminated {rc=256} 13:27:14.185444 --- ParallelTerminationStrategy: PID 10322 died... 13:27:14.205551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10322): Terminated: ok {rc=0} 13:27:14.252493 --- ParallelTerminationStrategy: PID 10323 died... 13:27:14.272264 run iperf3-srv_10.42.42.10(pid=10323): Terminated {rc=256} 13:27:14.318532 --- ParallelTerminationStrategy: PID 10324 died... 13:27:14.338124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10324): Terminated: ok {rc=0} 13:27:14.384731 --- ParallelTerminationStrategy: PID 10325 died... 13:27:14.404382 run iperf3-srv_10.42.42.10(pid=10325): Terminated {rc=256} 13:27:14.450808 --- ParallelTerminationStrategy: PID 10326 died... 13:27:14.470664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10326): Terminated: ok {rc=0} 13:27:14.517364 --- ParallelTerminationStrategy: PID 10327 died... 13:27:14.537185 run iperf3-srv_10.42.42.10(pid=10327): Terminated {rc=256} 13:27:14.583896 --- ParallelTerminationStrategy: PID 10330 died... 13:27:14.603669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10330): Terminated: ok {rc=0} 13:27:14.650661 --- ParallelTerminationStrategy: PID 10333 died... 13:27:14.670520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10333): Terminated: ok {rc=0} 13:27:14.717470 --- ParallelTerminationStrategy: PID 10336 died... 13:27:14.737609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10336): Terminated: ok {rc=0} 13:27:14.826057 bus /gobi_4: Setting Powered False 13:27:15.929373 bus /gobi_4: Setting Powered False 13:27:17.056413 bus /gobi_1: Setting Powered False 13:27:18.153333 bus /gobi_1: Setting Powered False 13:27:19.265912 bus /gobi_0: Setting Powered False 13:27:20.363649 bus /gobi_0: Setting Powered False 13:27:21.481216 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 13:27:22.584670 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:22.596704 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:27:22.652588 tst ping.py: using LAC 21771 13:27:22.776618 tst ping.py: using RAC 96 13:27:22.899148 tst ping.py: using CellId 21771 13:27:23.018394 tst ping.py: using BVCI 21772 13:27:23.127672 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:23.138646 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:23.149394 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:23.160029 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:23.170615 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:23.181473 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:23.192126 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:23.202813 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:27:23.319884 tst ping.py:19: start network... 13:27:23.533481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:24.025812 run create_hlr_db(pid=10338): Launched 13:27:24.147349 bus /gobi_6: Setting Powered False 13:27:25.211893 run create_hlr_db(pid=10338): Terminated: ok {rc=0} 13:27:25.639474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10340): Launched 13:27:25.937380 run osmo-hlr_10.42.42.2(pid=10341): Launched 13:27:26.050421 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:26.563256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10343): Launched 13:27:26.859210 run osmo-stp_10.42.42.5(pid=10344): Launched 13:27:26.971302 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:27:27.481369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10346): Launched 13:27:27.595540 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:27:27.845267 run patchelf(pid=10347): Launched 13:27:28.009694 run osmo-stp_10.42.42.5(pid=10344): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10344)] 13:27:28.135216 run osmo-stp_10.42.42.5(pid=10344): stdout: | (launched: 2022-12-09_13:27:26.803767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:28.262227 run osmo-stp_10.42.42.5(pid=10344): stderr: | 20221209132726973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132726973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132726973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132726974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132726974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132726974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132726974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:28.390852 run osmo-stp_10.42.42.5(pid=10344): stdout: | (launched: 2022-12-09_13:27:26.803767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:28.511998 run osmo-stp_10.42.42.5(pid=10344): stderr: | 20221209132726973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132726973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132726973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132726974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132726974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132726974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132726974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:28.655587 run patchelf(pid=10347): Terminating (SIGINT) 13:27:28.821503 run patchelf(pid=10347): Terminated: ok {rc=0} 13:27:28.940706 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10344): Process ended prematurely: osmo-stp_10.42.42.5(pid=10344) [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10344)] [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 13:27:28.949565 tst ping.py:22: Test FAILED (6.4 sec) 13:27:28.976040 run osmo-hlr_10.42.42.2(pid=10341): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10341)] 13:27:29.023516 run osmo-hlr_10.42.42.2(pid=10341): stdout: | (launched: 2022-12-09_13:27:25.882645) 13:27:29.072566 run osmo-hlr_10.42.42.2(pid=10341): stderr: | 20221209132726056 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132726056 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132726057 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132726057 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132726057 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132726057 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132726078 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132726088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132726088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132726088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:29.122143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10340): Terminating (SIGTERM) 13:27:29.162213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10343): Terminating (SIGTERM) 13:27:29.201767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10346): Terminating (SIGTERM) 13:27:29.241645 --- ParallelTerminationStrategy: PID 10340 died... 13:27:29.260295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10340): Terminated: ok {rc=0} 13:27:29.304412 --- ParallelTerminationStrategy: PID 10343 died... 13:27:29.323127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10343): Terminated: ok {rc=0} 13:27:29.366929 --- ParallelTerminationStrategy: PID 10346 died... 13:27:29.385600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10346): Terminated: ok {rc=0} 13:27:29.471387 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:27:30.558002 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:30.569323 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:27:30.619745 tst ping_idle_ping.py: using LAC 21772 13:27:30.741935 tst ping_idle_ping.py: using RAC 97 13:27:30.871007 tst ping_idle_ping.py: using CellId 21772 13:27:31.009458 tst ping_idle_ping.py: using BVCI 21773 13:27:31.132788 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:31.145630 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:31.158728 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:31.173581 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:31.187004 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:31.199178 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:31.213093 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:27:31.227296 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:27:31.355294 tst ping_idle_ping.py:24: start network... 13:27:31.628202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:32.150109 run create_hlr_db(pid=10348): Launched 13:27:32.286459 bus /gobi_6: Setting Powered False 13:27:33.349325 run create_hlr_db(pid=10348): Terminated: ok {rc=0} 13:27:33.777209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10350): Launched 13:27:34.098200 run osmo-hlr_10.42.42.2(pid=10351): Launched 13:27:34.220379 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:34.769848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10353): Launched 13:27:35.090225 run osmo-stp_10.42.42.5(pid=10354): Launched 13:27:35.212106 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:27:35.763657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10356): Launched 13:27:35.889392 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:27:36.158884 run patchelf(pid=10360): Launched 13:27:36.338106 run osmo-stp_10.42.42.5(pid=10354): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10354)] 13:27:36.473457 run osmo-stp_10.42.42.5(pid=10354): stdout: | (launched: 2022-12-09_13:27:35.032049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:36.610146 run osmo-stp_10.42.42.5(pid=10354): stderr: | 20221209132735222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132735222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132735222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132735223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132735223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132735223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132735223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:36.747213 run osmo-stp_10.42.42.5(pid=10354): stdout: | (launched: 2022-12-09_13:27:35.032049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:36.877598 run osmo-stp_10.42.42.5(pid=10354): stderr: | 20221209132735222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132735222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132735222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132735223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132735223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132735223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132735223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:37.032316 run patchelf(pid=10360): Terminating (SIGINT) 13:27:37.210946 run patchelf(pid=10360): Terminated: ok {rc=0} 13:27:37.339816 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10354): Process ended prematurely: osmo-stp_10.42.42.5(pid=10354) [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10354)] [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 13:27:37.349520 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 13:27:37.378188 run osmo-hlr_10.42.42.2(pid=10351): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10351)] 13:27:37.429138 run osmo-hlr_10.42.42.2(pid=10351): stdout: | (launched: 2022-12-09_13:27:34.038759) 13:27:37.481608 run osmo-hlr_10.42.42.2(pid=10351): stderr: | 20221209132734237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132734237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132734237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132734237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132734237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132734237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132734249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132734257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132734257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132734257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:37.534835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10350): Terminating (SIGTERM) 13:27:37.576911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10353): Terminating (SIGTERM) 13:27:37.618971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10356): Terminating (SIGTERM) 13:27:37.661179 --- ParallelTerminationStrategy: PID 10350 died... 13:27:37.681256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10350): Terminated: ok {rc=0} 13:27:37.727437 --- ParallelTerminationStrategy: PID 10353 died... 13:27:37.746962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10353): Terminated: ok {rc=0} 13:27:37.793104 --- ParallelTerminationStrategy: PID 10356 died... 13:27:37.812561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10356): Terminated: ok {rc=0} 13:27:37.901208 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:27:39.212737 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:27:39.221505 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:27:39.256196 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:27:39.296042 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:27:39.383389 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:27:39.417083 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:27:39.456774 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:27:40.053651 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:27:40.104080 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:40.115247 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:27:40.183245 tst cs_paging_gprs_active.py: using LAC 21773 13:27:40.301459 tst cs_paging_gprs_active.py: using RAC 98 13:27:40.419407 tst cs_paging_gprs_active.py: using CellId 21773 13:27:40.539363 tst cs_paging_gprs_active.py: using BVCI 21774 13:27:40.651104 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:40.661962 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:40.672620 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:40.683389 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:40.694503 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:40.705357 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:40.716210 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:40.727081 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:40.737834 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:27:40.859342 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:27:40.975274 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:27:41.179547 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:41.484500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10364): Launched 13:27:41.749572 run iperf3-srv_10.42.42.10(pid=10365): Launched 13:27:41.862727 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:27:42.065414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:42.369105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10366): Launched 13:27:42.632220 run iperf3-srv_10.42.42.10(pid=10367): Launched 13:27:42.745163 tst cs_paging_gprs_active.py:38: start network... 13:27:42.947576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:43.416429 run create_hlr_db(pid=10368): Launched 13:27:43.540243 bus /gobi_6: Setting Powered False 13:27:44.601717 run create_hlr_db(pid=10368): Terminated: ok {rc=0} 13:27:45.044391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10370): Launched 13:27:45.369702 run osmo-hlr_10.42.42.2(pid=10371): Launched 13:27:45.493568 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:46.064722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10373): Launched 13:27:46.467984 run osmo-stp_10.42.42.5(pid=10374): Launched 13:27:46.707774 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:27:47.529505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10376): Launched 13:27:47.644512 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:27:47.908241 run patchelf(pid=10377): Launched 13:27:48.076113 run osmo-stp_10.42.42.5(pid=10374): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10374)] 13:27:48.204440 run osmo-stp_10.42.42.5(pid=10374): stdout: | (launched: 2022-12-09_13:27:46.407502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:48.334255 run osmo-stp_10.42.42.5(pid=10374): stderr: | 20221209132746767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132746768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132746769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132746771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132746774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132746777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132746777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:48.464328 run osmo-stp_10.42.42.5(pid=10374): stdout: | (launched: 2022-12-09_13:27:46.407502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:48.588610 run osmo-stp_10.42.42.5(pid=10374): stderr: | 20221209132746767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132746768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132746769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132746771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132746774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132746777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132746777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:48.735645 run patchelf(pid=10377): Terminating (SIGINT) 13:27:48.904597 run patchelf(pid=10377): Terminated: ok {rc=0} 13:27:49.026825 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10374): Process ended prematurely: osmo-stp_10.42.42.5(pid=10374) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10374)] [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:27:49.036269 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 13:27:49.063379 run osmo-hlr_10.42.42.2(pid=10371): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10371)] 13:27:49.110838 run osmo-hlr_10.42.42.2(pid=10371): stdout: | (launched: 2022-12-09_13:27:45.310455) 13:27:49.159848 run osmo-hlr_10.42.42.2(pid=10371): stderr: | 20221209132745508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132745508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132745508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132745508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132745508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132745508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132745521 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132745529 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132745530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132745530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:49.209434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10364): Terminating (SIGTERM) 13:27:49.249228 run iperf3-srv_10.42.42.10(pid=10365): Terminating (SIGTERM) 13:27:49.288672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10366): Terminating (SIGTERM) 13:27:49.328202 run iperf3-srv_10.42.42.10(pid=10367): Terminating (SIGTERM) 13:27:49.367640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10370): Terminating (SIGTERM) 13:27:49.407296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10373): Terminating (SIGTERM) 13:27:49.446805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10376): Terminating (SIGTERM) 13:27:49.486745 --- ParallelTerminationStrategy: PID 10364 died... 13:27:49.505545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10364): Terminated: ok {rc=0} 13:27:49.549346 --- ParallelTerminationStrategy: PID 10365 died... 13:27:49.567691 run iperf3-srv_10.42.42.10(pid=10365): Terminated {rc=256} 13:27:49.611204 --- ParallelTerminationStrategy: PID 10366 died... 13:27:49.629844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10366): Terminated: ok {rc=0} 13:27:49.674026 --- ParallelTerminationStrategy: PID 10367 died... 13:27:49.692532 run iperf3-srv_10.42.42.10(pid=10367): Terminated {rc=256} 13:27:49.736024 --- ParallelTerminationStrategy: PID 10370 died... 13:27:49.755112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10370): Terminated: ok {rc=0} 13:27:49.799169 --- ParallelTerminationStrategy: PID 10373 died... 13:27:49.817985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10373): Terminated: ok {rc=0} 13:27:49.861647 --- ParallelTerminationStrategy: PID 10376 died... 13:27:49.880235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10376): Terminated: ok {rc=0} 13:27:49.963708 bus /gobi_0: Setting Powered False 13:27:51.061842 bus /gobi_0: Setting Powered False 13:27:52.179881 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:27:53.325804 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:53.337312 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:27:53.406532 tst iperf3.py: using LAC 21774 13:27:53.527356 tst iperf3.py: using RAC 99 13:27:53.647837 tst iperf3.py: using CellId 21774 13:27:53.768762 tst iperf3.py: using BVCI 21775 13:27:53.879758 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:53.890689 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:53.901614 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:53.912280 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:53.922868 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:53.933553 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:53.944297 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:53.954856 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:53.965622 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:27:54.081910 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:27:54.283857 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:54.586557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10378): Launched 13:27:54.849167 run iperf3-srv_10.42.42.10(pid=10379): Launched 13:27:54.962899 tst iperf3.py:8: start network... 13:27:55.165536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:55.634968 run create_hlr_db(pid=10380): Launched 13:27:55.759067 bus /gobi_6: Setting Powered False 13:27:56.819876 run create_hlr_db(pid=10380): Terminated: ok {rc=0} 13:27:57.262018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10382): Launched 13:27:57.586286 run osmo-hlr_10.42.42.2(pid=10383): Launched 13:27:57.711425 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:58.364644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10385): Launched 13:27:58.680563 run osmo-stp_10.42.42.5(pid=10386): Launched 13:27:58.801710 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:27:59.348781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10388): Launched 13:27:59.469254 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:27:59.737145 run patchelf(pid=10389): Launched 13:27:59.912576 run osmo-stp_10.42.42.5(pid=10386): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10386)] 13:28:00.047193 run osmo-stp_10.42.42.5(pid=10386): stdout: | (launched: 2022-12-09_13:27:58.622727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:00.182918 run osmo-stp_10.42.42.5(pid=10386): stderr: | 20221209132758815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132758815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132758816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132758816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132758816 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132758817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132758817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:00.319865 run osmo-stp_10.42.42.5(pid=10386): stdout: | (launched: 2022-12-09_13:27:58.622727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:00.450337 run osmo-stp_10.42.42.5(pid=10386): stderr: | 20221209132758815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132758815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132758816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132758816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132758816 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132758817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132758817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:00.604666 run patchelf(pid=10389): Terminating (SIGINT) 13:28:00.781315 run patchelf(pid=10389): Terminated: ok {rc=0} 13:28:00.935879 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10386): Process ended prematurely: osmo-stp_10.42.42.5(pid=10386) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10386)] [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 13:28:00.947093 tst iperf3.py:8: Test FAILED (7.7 sec) 13:28:00.982621 run osmo-hlr_10.42.42.2(pid=10383): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10383)] 13:28:01.034766 run osmo-hlr_10.42.42.2(pid=10383): stdout: | (launched: 2022-12-09_13:27:57.527509) 13:28:01.088566 run osmo-hlr_10.42.42.2(pid=10383): stderr: | 20221209132757725 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132757725 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132757725 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132757726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132757726 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132757726 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132757738 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132757746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132757747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132757747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:01.142720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10378): Terminating (SIGTERM) 13:28:01.186817 run iperf3-srv_10.42.42.10(pid=10379): Terminating (SIGTERM) 13:28:01.233621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10382): Terminating (SIGTERM) 13:28:01.278104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10385): Terminating (SIGTERM) 13:28:01.322344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10388): Terminating (SIGTERM) 13:28:01.367964 --- ParallelTerminationStrategy: PID 10378 died... 13:28:01.388518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10378): Terminated: ok {rc=0} 13:28:01.437356 --- ParallelTerminationStrategy: PID 10379 died... 13:28:01.457869 run iperf3-srv_10.42.42.10(pid=10379): Terminated {rc=256} 13:28:01.506436 --- ParallelTerminationStrategy: PID 10382 died... 13:28:01.527089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10382): Terminated: ok {rc=0} 13:28:01.575446 --- ParallelTerminationStrategy: PID 10385 died... 13:28:01.596380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10385): Terminated: ok {rc=0} 13:28:01.645081 --- ParallelTerminationStrategy: PID 10388 died... 13:28:01.665466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10388): Terminated: ok {rc=0} 13:28:01.756141 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:28:02.903197 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:02.914667 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:28:02.982807 tst iperf3m4.py: using LAC 21775 13:28:03.099870 tst iperf3m4.py: using RAC 100 13:28:03.218597 tst iperf3m4.py: using CellId 21775 13:28:03.337392 tst iperf3m4.py: using BVCI 21776 13:28:03.445086 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:03.455959 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:03.466542 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:03.477086 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:03.487752 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:03.498647 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:03.509491 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:03.520122 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:03.531064 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:28:03.646630 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:28:03.765312 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:28:03.881334 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:28:03.998207 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:28:04.197838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:28:04.494767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10390): Launched 13:28:04.752549 run iperf3-srv_10.42.42.10(pid=10391): Launched 13:28:04.863818 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:28:05.060571 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:28:05.358298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10392): Launched 13:28:05.615252 run iperf3-srv_10.42.42.10(pid=10393): Launched 13:28:05.726242 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:28:05.924177 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:28:06.220921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10394): Launched 13:28:06.478425 run iperf3-srv_10.42.42.10(pid=10395): Launched 13:28:06.588871 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:28:06.785712 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:28:07.082085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10396): Launched 13:28:07.338738 run iperf3-srv_10.42.42.10(pid=10397): Launched 13:28:07.449493 tst iperf3m4.py:8: start network... 13:28:07.646164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:08.106765 run create_hlr_db(pid=10398): Launched 13:28:08.227388 bus /gobi_6: Setting Powered False 13:28:09.286376 run create_hlr_db(pid=10398): Terminated: ok {rc=0} 13:28:09.718735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10400): Launched 13:28:10.034621 run osmo-hlr_10.42.42.2(pid=10401): Launched 13:28:10.154556 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:10.700858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10403): Launched 13:28:11.015289 run osmo-stp_10.42.42.5(pid=10404): Launched 13:28:11.136017 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:28:11.682323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10406): Launched 13:28:11.802715 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:28:12.070327 run patchelf(pid=10407): Launched 13:28:12.247582 run osmo-stp_10.42.42.5(pid=10404): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10404)] 13:28:12.381870 run osmo-stp_10.42.42.5(pid=10404): stdout: | (launched: 2022-12-09_13:28:10.957827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:12.517508 run osmo-stp_10.42.42.5(pid=10404): stderr: | 20221209132811145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132811145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132811146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132811146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132811146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132811147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132811147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:12.653123 run osmo-stp_10.42.42.5(pid=10404): stdout: | (launched: 2022-12-09_13:28:10.957827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:12.783270 run osmo-stp_10.42.42.5(pid=10404): stderr: | 20221209132811145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132811145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132811146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132811146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132811146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132811147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132811147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:12.937052 run patchelf(pid=10407): Terminating (SIGINT) 13:28:13.113656 run patchelf(pid=10407): Terminated: ok {rc=0} 13:28:13.241593 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10404): Process ended prematurely: osmo-stp_10.42.42.5(pid=10404) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10404)] [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:28:13.251684 tst iperf3m4.py:8: Test FAILED (10.4 sec) 13:28:13.281402 run osmo-hlr_10.42.42.2(pid=10401): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10401)] 13:28:13.331704 run osmo-hlr_10.42.42.2(pid=10401): stdout: | (launched: 2022-12-09_13:28:09.976724) 13:28:13.383757 run osmo-hlr_10.42.42.2(pid=10401): stderr: | 20221209132810170 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132810170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132810170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132810170 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132810170 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132810170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132810183 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132810193 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132810193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132810193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:13.436216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10390): Terminating (SIGTERM) 13:28:13.478712 run iperf3-srv_10.42.42.10(pid=10391): Terminating (SIGTERM) 13:28:13.521392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10392): Terminating (SIGTERM) 13:28:13.564000 run iperf3-srv_10.42.42.10(pid=10393): Terminating (SIGTERM) 13:28:13.606413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10394): Terminating (SIGTERM) 13:28:13.648608 run iperf3-srv_10.42.42.10(pid=10395): Terminating (SIGTERM) 13:28:13.690683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10396): Terminating (SIGTERM) 13:28:13.732667 run iperf3-srv_10.42.42.10(pid=10397): Terminating (SIGTERM) 13:28:13.774651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10400): Terminating (SIGTERM) 13:28:13.816787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10403): Terminating (SIGTERM) 13:28:13.858917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10406): Terminating (SIGTERM) 13:28:13.901299 --- ParallelTerminationStrategy: PID 10390 died... 13:28:13.921309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10390): Terminated: ok {rc=0} 13:28:13.967938 --- ParallelTerminationStrategy: PID 10391 died... 13:28:13.987500 run iperf3-srv_10.42.42.10(pid=10391): Terminated {rc=256} 13:28:14.033641 --- ParallelTerminationStrategy: PID 10392 died... 13:28:14.052874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10392): Terminated: ok {rc=0} 13:28:14.099041 --- ParallelTerminationStrategy: PID 10393 died... 13:28:14.118414 run iperf3-srv_10.42.42.10(pid=10393): Terminated {rc=256} 13:28:14.164355 --- ParallelTerminationStrategy: PID 10394 died... 13:28:14.183831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10394): Terminated: ok {rc=0} 13:28:14.229800 --- ParallelTerminationStrategy: PID 10395 died... 13:28:14.249618 run iperf3-srv_10.42.42.10(pid=10395): Terminated {rc=256} 13:28:14.295675 --- ParallelTerminationStrategy: PID 10396 died... 13:28:14.315191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10396): Terminated: ok {rc=0} 13:28:14.361424 --- ParallelTerminationStrategy: PID 10397 died... 13:28:14.380890 run iperf3-srv_10.42.42.10(pid=10397): Terminated {rc=256} 13:28:14.426886 --- ParallelTerminationStrategy: PID 10400 died... 13:28:14.446378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10400): Terminated: ok {rc=0} 13:28:14.492189 --- ParallelTerminationStrategy: PID 10403 died... 13:28:14.511799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10403): Terminated: ok {rc=0} 13:28:14.558260 --- ParallelTerminationStrategy: PID 10406 died... 13:28:14.577784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10406): Terminated: ok {rc=0} 13:28:14.664486 bus /gobi_4: Setting Powered False 13:28:15.763954 bus /gobi_4: Setting Powered False 13:28:16.884715 bus /gobi_1: Setting Powered False 13:28:17.990584 bus /gobi_1: Setting Powered False 13:28:19.104081 bus /gobi_0: Setting Powered False 13:28:20.201869 bus /gobi_0: Setting Powered False 13:28:21.318041 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:28:22.417144 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:22.428470 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:28:22.497142 tst ping.py: using LAC 21776 13:28:22.613153 tst ping.py: using RAC 101 13:28:22.727813 tst ping.py: using CellId 21776 13:28:22.845943 tst ping.py: using BVCI 21777 13:28:22.952032 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:22.963174 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:22.973860 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:22.984649 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:22.995427 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:23.006354 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:23.017251 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:23.028044 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:28:23.144087 tst ping.py:19: start network... 13:28:23.354406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:23.840303 run create_hlr_db(pid=10408): Launched 13:28:23.960210 bus /gobi_6: Setting Powered False 13:28:25.022869 run create_hlr_db(pid=10408): Terminated: ok {rc=0} 13:28:25.460309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10410): Launched 13:28:25.772656 run osmo-hlr_10.42.42.2(pid=10411): Launched 13:28:25.891441 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:26.431478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10413): Launched 13:28:26.743997 run osmo-stp_10.42.42.5(pid=10414): Launched 13:28:26.863317 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:28:27.402040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10416): Launched 13:28:27.523066 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:28:27.787012 run patchelf(pid=10417): Launched 13:28:27.960905 run osmo-stp_10.42.42.5(pid=10414): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10414)] 13:28:28.094451 run osmo-stp_10.42.42.5(pid=10414): stdout: | (launched: 2022-12-09_13:28:26.686635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:28.229312 run osmo-stp_10.42.42.5(pid=10414): stderr: | 20221209132826876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132826876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132826877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132826877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132826878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132826878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132826878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:28.364421 run osmo-stp_10.42.42.5(pid=10414): stdout: | (launched: 2022-12-09_13:28:26.686635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:28.493537 run osmo-stp_10.42.42.5(pid=10414): stderr: | 20221209132826876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132826876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132826877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132826877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132826878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132826878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132826878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:28.646353 run patchelf(pid=10417): Terminating (SIGINT) 13:28:28.821222 run patchelf(pid=10417): Terminated: ok {rc=0} 13:28:28.947747 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10414): Process ended prematurely: osmo-stp_10.42.42.5(pid=10414) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10414)] [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 13:28:28.957601 tst ping.py:22: Test FAILED (6.5 sec) 13:28:28.985871 run osmo-hlr_10.42.42.2(pid=10411): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10411)] 13:28:29.036920 run osmo-hlr_10.42.42.2(pid=10411): stdout: | (launched: 2022-12-09_13:28:25.714986) 13:28:29.089616 run osmo-hlr_10.42.42.2(pid=10411): stderr: | 20221209132825911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132825911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132825911 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132825911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132825911 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132825911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132825924 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132825932 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132825932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132825933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:29.142906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10410): Terminating (SIGTERM) 13:28:29.185408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10413): Terminating (SIGTERM) 13:28:29.227925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10416): Terminating (SIGTERM) 13:28:29.270928 --- ParallelTerminationStrategy: PID 10410 died... 13:28:29.291152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10410): Terminated: ok {rc=0} 13:28:29.338269 --- ParallelTerminationStrategy: PID 10413 died... 13:28:29.357815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10413): Terminated: ok {rc=0} 13:28:29.404613 --- ParallelTerminationStrategy: PID 10416 died... 13:28:29.424382 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10416): Terminated: ok {rc=0} 13:28:29.513350 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:28:30.601424 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:30.613472 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:28:30.686880 tst ping_idle_ping.py: using LAC 21777 13:28:30.809358 tst ping_idle_ping.py: using RAC 102 13:28:30.953332 tst ping_idle_ping.py: using CellId 21777 13:28:31.079343 tst ping_idle_ping.py: using BVCI 21778 13:28:31.189410 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:31.200737 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:31.212175 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:31.224313 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:31.236174 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:31.248000 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:31.259827 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:28:31.271637 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:28:31.388123 tst ping_idle_ping.py:24: start network... 13:28:31.623270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:32.122101 run create_hlr_db(pid=10418): Launched 13:28:32.276439 bus /gobi_6: Setting Powered False 13:28:33.338476 run create_hlr_db(pid=10418): Terminated: ok {rc=0} 13:28:33.774647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10420): Launched 13:28:34.088675 run osmo-hlr_10.42.42.2(pid=10421): Launched 13:28:34.207475 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:34.749274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10423): Launched 13:28:35.062313 run osmo-stp_10.42.42.5(pid=10424): Launched 13:28:35.181067 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:28:35.719639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10426): Launched 13:28:35.839309 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:28:36.102907 run patchelf(pid=10427): Launched 13:28:36.277161 run osmo-stp_10.42.42.5(pid=10424): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10424)] 13:28:36.410747 run osmo-stp_10.42.42.5(pid=10424): stdout: | (launched: 2022-12-09_13:28:35.005163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:36.545804 run osmo-stp_10.42.42.5(pid=10424): stderr: | 20221209132835194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132835194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132835194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132835195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132835195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132835195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132835195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:36.680613 run osmo-stp_10.42.42.5(pid=10424): stdout: | (launched: 2022-12-09_13:28:35.005163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:36.809816 run osmo-stp_10.42.42.5(pid=10424): stderr: | 20221209132835194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132835194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132835194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132835195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132835195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132835195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132835195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:36.962385 run patchelf(pid=10427): Terminating (SIGINT) 13:28:37.137802 run patchelf(pid=10427): Terminated: ok {rc=0} 13:28:37.264802 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10424): Process ended prematurely: osmo-stp_10.42.42.5(pid=10424) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10424)] [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:28:37.274774 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:28:37.303227 run osmo-hlr_10.42.42.2(pid=10421): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10421)] 13:28:37.353632 run osmo-hlr_10.42.42.2(pid=10421): stdout: | (launched: 2022-12-09_13:28:34.031329) 13:28:37.405873 run osmo-hlr_10.42.42.2(pid=10421): stderr: | 20221209132834228 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132834228 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132834229 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132834229 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132834229 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132834229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132834241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132834249 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132834250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132834250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:37.458264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10420): Terminating (SIGTERM) 13:28:37.500441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10423): Terminating (SIGTERM) 13:28:37.542535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10426): Terminating (SIGTERM) 13:28:37.584806 --- ParallelTerminationStrategy: PID 10420 died... 13:28:37.604721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10420): Terminated: ok {rc=0} 13:28:37.651185 --- ParallelTerminationStrategy: PID 10423 died... 13:28:37.671378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10423): Terminated: ok {rc=0} 13:28:37.717224 --- ParallelTerminationStrategy: PID 10426 died... 13:28:37.736556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10426): Terminated: ok {rc=0} 13:28:37.823620 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:28:39.124098 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:28:39.130560 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:28:39.164543 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:28:39.203223 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:28:39.290427 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:28:39.322732 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:28:39.361162 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:28:39.953958 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:28:40.004037 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:40.015075 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:28:40.085270 tst cs_paging_gprs_active.py: using LAC 21778 13:28:40.204255 tst cs_paging_gprs_active.py: using RAC 103 13:28:40.324855 tst cs_paging_gprs_active.py: using CellId 21778 13:28:40.444492 tst cs_paging_gprs_active.py: using BVCI 21779 13:28:40.554416 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:40.565386 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:40.576058 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:40.586857 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:40.597517 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:40.608180 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:40.618964 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:40.629728 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:40.640654 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:28:40.759252 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:28:40.878401 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:28:41.078643 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:28:41.377789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10432): Launched 13:28:41.637313 run iperf3-srv_10.42.42.10(pid=10433): Launched 13:28:41.749131 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:28:41.948772 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:28:42.249715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10434): Launched 13:28:42.509983 run iperf3-srv_10.42.42.10(pid=10435): Launched 13:28:42.621913 tst cs_paging_gprs_active.py:38: start network... 13:28:42.821062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:43.284086 run create_hlr_db(pid=10436): Launched 13:28:43.406471 bus /gobi_6: Setting Powered False 13:28:44.466142 run create_hlr_db(pid=10436): Terminated: ok {rc=0} 13:28:44.902311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10438): Launched 13:28:45.220654 run osmo-hlr_10.42.42.2(pid=10439): Launched 13:28:45.343009 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:45.911673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10441): Launched 13:28:46.258470 run osmo-stp_10.42.42.5(pid=10442): Launched 13:28:46.501890 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:28:47.177709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10444): Launched 13:28:47.307197 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:28:47.580349 run patchelf(pid=10445): Launched 13:28:47.757412 run osmo-stp_10.42.42.5(pid=10442): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10442)] 13:28:47.892219 run osmo-stp_10.42.42.5(pid=10442): stdout: | (launched: 2022-12-09_13:28:46.197948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:48.028392 run osmo-stp_10.42.42.5(pid=10442): stderr: | 20221209132846495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132846496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132846496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132846496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132846497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132846497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132846497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:48.165124 run osmo-stp_10.42.42.5(pid=10442): stdout: | (launched: 2022-12-09_13:28:46.197948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:48.296034 run osmo-stp_10.42.42.5(pid=10442): stderr: | 20221209132846495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132846496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132846496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132846496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132846497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132846497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132846497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:48.451211 run patchelf(pid=10445): Terminating (SIGINT) 13:28:48.628501 run patchelf(pid=10445): Terminated: ok {rc=0} 13:28:48.756773 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10442): Process ended prematurely: osmo-stp_10.42.42.5(pid=10442) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10442)] [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:28:48.767024 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:28:48.795948 run osmo-hlr_10.42.42.2(pid=10439): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10439)] 13:28:48.845820 run osmo-hlr_10.42.42.2(pid=10439): stdout: | (launched: 2022-12-09_13:28:45.162355) 13:28:48.897477 run osmo-hlr_10.42.42.2(pid=10439): stderr: | 20221209132845360 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132845360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132845360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132845360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132845360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132845360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132845372 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132845381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132845381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132845381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:48.949657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10432): Terminating (SIGTERM) 13:28:48.991309 run iperf3-srv_10.42.42.10(pid=10433): Terminating (SIGTERM) 13:28:49.034454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10434): Terminating (SIGTERM) 13:28:49.076553 run iperf3-srv_10.42.42.10(pid=10435): Terminating (SIGTERM) 13:28:49.118234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10438): Terminating (SIGTERM) 13:28:49.160103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10441): Terminating (SIGTERM) 13:28:49.201626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10444): Terminating (SIGTERM) 13:28:49.243276 --- ParallelTerminationStrategy: PID 10432 died... 13:28:49.263760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10432): Terminated: ok {rc=0} 13:28:49.310228 --- ParallelTerminationStrategy: PID 10433 died... 13:28:49.329730 run iperf3-srv_10.42.42.10(pid=10433): Terminated {rc=256} 13:28:49.375966 --- ParallelTerminationStrategy: PID 10434 died... 13:28:49.395469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10434): Terminated: ok {rc=0} 13:28:49.441777 --- ParallelTerminationStrategy: PID 10435 died... 13:28:49.461042 run iperf3-srv_10.42.42.10(pid=10435): Terminated {rc=256} 13:28:49.507143 --- ParallelTerminationStrategy: PID 10438 died... 13:28:49.526645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10438): Terminated: ok {rc=0} 13:28:49.572777 --- ParallelTerminationStrategy: PID 10441 died... 13:28:49.592764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10441): Terminated: ok {rc=0} 13:28:49.639178 --- ParallelTerminationStrategy: PID 10444 died... 13:28:49.658734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10444): Terminated: ok {rc=0} 13:28:49.746628 bus /gobi_0: Setting Powered False 13:28:50.844858 bus /gobi_0: Setting Powered False 13:28:51.962953 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:28:53.112516 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:53.124542 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:28:53.196052 tst iperf3.py: using LAC 21779 13:28:53.321065 tst iperf3.py: using RAC 104 13:28:53.447116 tst iperf3.py: using CellId 21779 13:28:53.576645 tst iperf3.py: using BVCI 21780 13:28:53.692494 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:53.704044 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:53.715328 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:53.726933 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:53.738490 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:53.750161 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:53.761789 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:53.773325 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:53.784820 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:28:53.900082 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:28:54.113770 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:28:54.432854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10446): Launched 13:28:54.710847 run iperf3-srv_10.42.42.10(pid=10447): Launched 13:28:54.829810 tst iperf3.py:8: start network... 13:28:55.042802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:55.534616 run create_hlr_db(pid=10448): Launched 13:28:55.655135 bus /gobi_6: Setting Powered False 13:28:56.717918 run create_hlr_db(pid=10448): Terminated: ok {rc=0} 13:28:57.157751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10450): Launched 13:28:57.474625 run osmo-hlr_10.42.42.2(pid=10451): Launched 13:28:57.596354 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:58.146690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10453): Launched 13:28:58.465593 run osmo-stp_10.42.42.5(pid=10454): Launched 13:28:58.587157 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:28:59.135435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10456): Launched 13:28:59.257821 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:28:59.526231 run patchelf(pid=10457): Launched 13:28:59.703627 run osmo-stp_10.42.42.5(pid=10454): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10454)] 13:28:59.838469 run osmo-stp_10.42.42.5(pid=10454): stdout: | (launched: 2022-12-09_13:28:58.407285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:59.974938 run osmo-stp_10.42.42.5(pid=10454): stderr: | 20221209132858598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132858598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132858598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132858598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132858599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132858599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132858599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:00.111291 run osmo-stp_10.42.42.5(pid=10454): stdout: | (launched: 2022-12-09_13:28:58.407285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:00.241954 run osmo-stp_10.42.42.5(pid=10454): stderr: | 20221209132858598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132858598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132858598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132858598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132858599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132858599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132858599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:00.397862 run patchelf(pid=10457): Terminating (SIGINT) 13:29:00.575719 run patchelf(pid=10457): Terminated: ok {rc=0} 13:29:00.704058 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10454): Process ended prematurely: osmo-stp_10.42.42.5(pid=10454) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10454)] [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 13:29:00.714195 tst iperf3.py:8: Test FAILED (7.6 sec) 13:29:00.743126 run osmo-hlr_10.42.42.2(pid=10451): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10451)] 13:29:00.793260 run osmo-hlr_10.42.42.2(pid=10451): stdout: | (launched: 2022-12-09_13:28:57.416363) 13:29:00.847251 run osmo-hlr_10.42.42.2(pid=10451): stderr: | 20221209132857615 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132857615 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132857615 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132857615 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132857615 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132857615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132857627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132857635 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132857636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132857636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:00.901478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10446): Terminating (SIGTERM) 13:29:00.942945 run iperf3-srv_10.42.42.10(pid=10447): Terminating (SIGTERM) 13:29:00.987070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10450): Terminating (SIGTERM) 13:29:01.030022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10453): Terminating (SIGTERM) 13:29:01.073501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10456): Terminating (SIGTERM) 13:29:01.118499 --- ParallelTerminationStrategy: PID 10446 died... 13:29:01.138318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10446): Terminated: ok {rc=0} 13:29:01.185257 --- ParallelTerminationStrategy: PID 10447 died... 13:29:01.204348 run iperf3-srv_10.42.42.10(pid=10447): Terminated {rc=256} 13:29:01.249192 --- ParallelTerminationStrategy: PID 10450 died... 13:29:01.269186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10450): Terminated: ok {rc=0} 13:29:01.316314 --- ParallelTerminationStrategy: PID 10453 died... 13:29:01.335582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10453): Terminated: ok {rc=0} 13:29:01.381409 --- ParallelTerminationStrategy: PID 10456 died... 13:29:01.400416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10456): Terminated: ok {rc=0} 13:29:01.487792 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:29:02.642036 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:02.654125 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:29:02.728022 tst iperf3m4.py: using LAC 21780 13:29:02.852580 tst iperf3m4.py: using RAC 105 13:29:02.975377 tst iperf3m4.py: using CellId 21780 13:29:03.098300 tst iperf3m4.py: using BVCI 21781 13:29:03.215651 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:03.226997 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:03.238193 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:03.249551 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:03.261263 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:03.272517 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:03.284125 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:03.295361 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:03.307229 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:29:03.422942 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:29:03.544555 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:29:03.659192 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:29:03.777553 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:29:03.991774 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:29:04.311098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10458): Launched 13:29:04.587777 run iperf3-srv_10.42.42.10(pid=10459): Launched 13:29:04.707195 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:29:04.920188 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:29:05.238886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10460): Launched 13:29:05.516703 run iperf3-srv_10.42.42.10(pid=10461): Launched 13:29:05.635738 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:29:05.848664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:29:06.167814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10462): Launched 13:29:06.444915 run iperf3-srv_10.42.42.10(pid=10463): Launched 13:29:06.566474 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:29:06.779745 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:29:07.098726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10464): Launched 13:29:07.377296 run iperf3-srv_10.42.42.10(pid=10465): Launched 13:29:07.496750 tst iperf3m4.py:8: start network... 13:29:07.710495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:08.203775 run create_hlr_db(pid=10466): Launched 13:29:08.324875 bus /gobi_6: Setting Powered False 13:29:09.386904 run create_hlr_db(pid=10466): Terminated: ok {rc=0} 13:29:09.812723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10468): Launched 13:29:10.110597 run osmo-hlr_10.42.42.2(pid=10469): Launched 13:29:10.224086 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:10.753693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10471): Launched 13:29:11.050442 run osmo-stp_10.42.42.5(pid=10472): Launched 13:29:11.163519 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:29:11.674938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10474): Launched 13:29:11.788639 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:29:12.040462 run patchelf(pid=10475): Launched 13:29:12.205767 run osmo-stp_10.42.42.5(pid=10472): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10472)] 13:29:12.332033 run osmo-stp_10.42.42.5(pid=10472): stdout: | (launched: 2022-12-09_13:29:10.995564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:12.460769 run osmo-stp_10.42.42.5(pid=10472): stderr: | 20221209132911164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132911164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132911165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132911165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132911166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132911166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132911166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:12.588525 run osmo-stp_10.42.42.5(pid=10472): stdout: | (launched: 2022-12-09_13:29:10.995564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:12.710701 run osmo-stp_10.42.42.5(pid=10472): stderr: | 20221209132911164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132911164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132911165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132911165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132911166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132911166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132911166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:12.855234 run patchelf(pid=10475): Terminating (SIGINT) 13:29:13.021354 run patchelf(pid=10475): Terminated: ok {rc=0} 13:29:13.141207 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10472): Process ended prematurely: osmo-stp_10.42.42.5(pid=10472) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10472)] [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:29:13.150598 tst iperf3m4.py:8: Test FAILED (10.6 sec) 13:29:13.177774 run osmo-hlr_10.42.42.2(pid=10469): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10469)] 13:29:13.224810 run osmo-hlr_10.42.42.2(pid=10469): stdout: | (launched: 2022-12-09_13:29:10.055782) 13:29:13.274135 run osmo-hlr_10.42.42.2(pid=10469): stderr: | 20221209132910230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132910230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132910230 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132910230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132910230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132910230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132910242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132910251 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132910251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132910251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:13.323924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10458): Terminating (SIGTERM) 13:29:13.363963 run iperf3-srv_10.42.42.10(pid=10459): Terminating (SIGTERM) 13:29:13.403401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10460): Terminating (SIGTERM) 13:29:13.442815 run iperf3-srv_10.42.42.10(pid=10461): Terminating (SIGTERM) 13:29:13.482180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10462): Terminating (SIGTERM) 13:29:13.521579 run iperf3-srv_10.42.42.10(pid=10463): Terminating (SIGTERM) 13:29:13.560820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10464): Terminating (SIGTERM) 13:29:13.600162 run iperf3-srv_10.42.42.10(pid=10465): Terminating (SIGTERM) 13:29:13.639271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10468): Terminating (SIGTERM) 13:29:13.678711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10471): Terminating (SIGTERM) 13:29:13.717951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10474): Terminating (SIGTERM) 13:29:13.757495 --- ParallelTerminationStrategy: PID 10458 died... 13:29:13.776233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10458): Terminated: ok {rc=0} 13:29:13.819971 --- ParallelTerminationStrategy: PID 10459 died... 13:29:13.838547 run iperf3-srv_10.42.42.10(pid=10459): Terminated {rc=256} 13:29:13.882300 --- ParallelTerminationStrategy: PID 10460 died... 13:29:13.900750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10460): Terminated: ok {rc=0} 13:29:13.943869 --- ParallelTerminationStrategy: PID 10461 died... 13:29:13.962182 run iperf3-srv_10.42.42.10(pid=10461): Terminated {rc=256} 13:29:14.005183 --- ParallelTerminationStrategy: PID 10462 died... 13:29:14.023528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10462): Terminated: ok {rc=0} 13:29:14.067129 --- ParallelTerminationStrategy: PID 10463 died... 13:29:14.085460 run iperf3-srv_10.42.42.10(pid=10463): Terminated {rc=256} 13:29:14.128683 --- ParallelTerminationStrategy: PID 10464 died... 13:29:14.147071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10464): Terminated: ok {rc=0} 13:29:14.190249 --- ParallelTerminationStrategy: PID 10465 died... 13:29:14.208644 run iperf3-srv_10.42.42.10(pid=10465): Terminated {rc=256} 13:29:14.251924 --- ParallelTerminationStrategy: PID 10468 died... 13:29:14.270385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10468): Terminated: ok {rc=0} 13:29:14.313685 --- ParallelTerminationStrategy: PID 10471 died... 13:29:14.332081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10471): Terminated: ok {rc=0} 13:29:14.375581 --- ParallelTerminationStrategy: PID 10474 died... 13:29:14.394137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10474): Terminated: ok {rc=0} 13:29:14.477596 bus /gobi_4: Setting Powered False 13:29:15.575145 bus /gobi_4: Setting Powered False 13:29:16.698658 bus /gobi_1: Setting Powered False 13:29:17.803884 bus /gobi_1: Setting Powered False 13:29:18.918171 bus /gobi_0: Setting Powered False 13:29:20.020492 bus /gobi_0: Setting Powered False 13:29:21.135536 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:29:22.238395 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:22.249910 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:29:22.322773 tst ping.py: using LAC 21781 13:29:22.436749 tst ping.py: using RAC 106 13:29:22.550987 tst ping.py: using CellId 21781 13:29:22.674772 tst ping.py: using BVCI 21782 13:29:22.789149 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:22.800778 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:22.811951 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:22.824109 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:22.836206 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:22.848304 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:22.860432 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:22.872309 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:29:22.990985 tst ping.py:19: start network... 13:29:23.200112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:23.685545 run create_hlr_db(pid=10476): Launched 13:29:23.804512 bus /gobi_6: Setting Powered False 13:29:24.867424 run create_hlr_db(pid=10476): Terminated: ok {rc=0} 13:29:25.287481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10478): Launched 13:29:25.580367 run osmo-hlr_10.42.42.2(pid=10479): Launched 13:29:25.691820 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:26.207096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10481): Launched 13:29:26.498286 run osmo-stp_10.42.42.5(pid=10482): Launched 13:29:26.609749 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:29:27.112805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10484): Launched 13:29:27.223772 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:29:27.469713 run patchelf(pid=10485): Launched 13:29:27.632051 run osmo-stp_10.42.42.5(pid=10482): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10482)] 13:29:27.756153 run osmo-stp_10.42.42.5(pid=10482): stdout: | (launched: 2022-12-09_13:29:26.444018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:27.881658 run osmo-stp_10.42.42.5(pid=10482): stderr: | 20221209132926611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132926612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132926612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132926612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132926613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132926613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132926613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:28.006895 run osmo-stp_10.42.42.5(pid=10482): stdout: | (launched: 2022-12-09_13:29:26.444018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:28.126928 run osmo-stp_10.42.42.5(pid=10482): stderr: | 20221209132926611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132926612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132926612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132926612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132926613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132926613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132926613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:28.268913 run patchelf(pid=10485): Terminating (SIGINT) 13:29:28.432649 run patchelf(pid=10485): Terminated: ok {rc=0} 13:29:28.551307 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10482): Process ended prematurely: osmo-stp_10.42.42.5(pid=10482) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10482)] [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 13:29:28.560186 tst ping.py:22: Test FAILED (6.3 sec) 13:29:28.586798 run osmo-hlr_10.42.42.2(pid=10479): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10479)] 13:29:28.634254 run osmo-hlr_10.42.42.2(pid=10479): stdout: | (launched: 2022-12-09_13:29:25.526495) 13:29:28.683573 run osmo-hlr_10.42.42.2(pid=10479): stderr: | 20221209132925701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132925701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132925701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132925701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132925701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132925702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132925713 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132925722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132925722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132925722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:28.733321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10478): Terminating (SIGTERM) 13:29:28.773310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10481): Terminating (SIGTERM) 13:29:28.813256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10484): Terminating (SIGTERM) 13:29:28.853959 --- ParallelTerminationStrategy: PID 10478 died... 13:29:28.873088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10478): Terminated: ok {rc=0} 13:29:28.917456 --- ParallelTerminationStrategy: PID 10481 died... 13:29:28.936032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10481): Terminated: ok {rc=0} 13:29:28.980103 --- ParallelTerminationStrategy: PID 10484 died... 13:29:28.998794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10484): Terminated: ok {rc=0} 13:29:29.084043 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:29:30.172195 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:30.184225 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:29:30.256930 tst ping_idle_ping.py: using LAC 21782 13:29:30.374238 tst ping_idle_ping.py: using RAC 107 13:29:30.489635 tst ping_idle_ping.py: using CellId 21782 13:29:30.606157 tst ping_idle_ping.py: using BVCI 21783 13:29:30.713105 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:30.724130 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:30.734877 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:30.745994 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:30.756765 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:30.767748 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:30.778796 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:29:30.789709 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:29:30.928040 tst ping_idle_ping.py:24: start network... 13:29:31.131093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:31.595100 run create_hlr_db(pid=10486): Launched 13:29:31.748543 bus /gobi_6: Setting Powered False 13:29:32.806697 run create_hlr_db(pid=10486): Terminated: ok {rc=0} 13:29:33.237681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10488): Launched 13:29:33.553985 run osmo-hlr_10.42.42.2(pid=10489): Launched 13:29:33.674192 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:34.216300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10491): Launched 13:29:34.532244 run osmo-stp_10.42.42.5(pid=10492): Launched 13:29:34.652754 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:29:35.194538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10494): Launched 13:29:35.315034 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:29:35.579976 run patchelf(pid=10495): Launched 13:29:35.756053 run osmo-stp_10.42.42.5(pid=10492): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10492)] 13:29:35.890122 run osmo-stp_10.42.42.5(pid=10492): stdout: | (launched: 2022-12-09_13:29:34.474725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:36.025801 run osmo-stp_10.42.42.5(pid=10492): stderr: | 20221209132934662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132934662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132934663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132934663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132934663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132934664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132934664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:36.161276 run osmo-stp_10.42.42.5(pid=10492): stdout: | (launched: 2022-12-09_13:29:34.474725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:36.291220 run osmo-stp_10.42.42.5(pid=10492): stderr: | 20221209132934662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132934662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132934663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132934663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132934663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132934664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132934664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:36.437925 run patchelf(pid=10495): Terminating (SIGINT) 13:29:36.603981 run patchelf(pid=10495): Terminated: ok {rc=0} 13:29:36.723589 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10492): Process ended prematurely: osmo-stp_10.42.42.5(pid=10492) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10492)] [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:29:36.732789 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:29:36.759861 run osmo-hlr_10.42.42.2(pid=10489): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10489)] 13:29:36.807927 run osmo-hlr_10.42.42.2(pid=10489): stdout: | (launched: 2022-12-09_13:29:33.495987) 13:29:36.857474 run osmo-hlr_10.42.42.2(pid=10489): stderr: | 20221209132933691 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132933692 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132933692 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132933692 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132933692 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132933692 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132933704 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132933712 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132933712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132933712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:36.907336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10488): Terminating (SIGTERM) 13:29:36.947186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10491): Terminating (SIGTERM) 13:29:36.986811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10494): Terminating (SIGTERM) 13:29:37.026581 --- ParallelTerminationStrategy: PID 10488 died... 13:29:37.045791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10488): Terminated: ok {rc=0} 13:29:37.090210 --- ParallelTerminationStrategy: PID 10491 died... 13:29:37.109046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10491): Terminated: ok {rc=0} 13:29:37.153061 --- ParallelTerminationStrategy: PID 10494 died... 13:29:37.171851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10494): Terminated: ok {rc=0} 13:29:37.257637 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:29:38.561959 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:29:38.568610 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:29:38.601552 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 13:29:38.640355 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 13:29:38.726494 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:29:38.758896 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 13:29:38.797163 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 13:29:39.400152 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 13:29:39.448796 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:39.460239 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:29:39.515903 tst cs_paging_gprs_active.py: using LAC 21783 13:29:39.633483 tst cs_paging_gprs_active.py: using RAC 108 13:29:39.751159 tst cs_paging_gprs_active.py: using CellId 21783 13:29:39.867610 tst cs_paging_gprs_active.py: using BVCI 21784 13:29:39.976484 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:39.987912 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:39.999019 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:40.010354 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:40.021517 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:40.032702 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:40.044025 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:40.055205 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:40.066661 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:29:40.179982 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:29:40.300333 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:29:40.516531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:29:40.837891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10499): Launched 13:29:41.115402 run iperf3-srv_10.42.42.10(pid=10500): Launched 13:29:41.235208 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:29:41.450776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:29:41.770905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10501): Launched 13:29:42.050164 run iperf3-srv_10.42.42.10(pid=10502): Launched 13:29:42.169896 tst cs_paging_gprs_active.py:38: start network... 13:29:42.385531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:42.882490 run create_hlr_db(pid=10503): Launched 13:29:43.007653 bus /gobi_6: Setting Powered False 13:29:44.067335 run create_hlr_db(pid=10503): Terminated: ok {rc=0} 13:29:44.504802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10505): Launched 13:29:44.824636 run osmo-hlr_10.42.42.2(pid=10506): Launched 13:29:44.948078 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:45.502174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10508): Launched 13:29:45.821622 run osmo-stp_10.42.42.5(pid=10509): Launched 13:29:46.075946 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:29:46.845844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10511): Launched 13:29:46.999334 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:29:47.279839 run patchelf(pid=10512): Launched 13:29:47.471288 run osmo-stp_10.42.42.5(pid=10509): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10509)] 13:29:47.607169 run osmo-stp_10.42.42.5(pid=10509): stdout: | (launched: 2022-12-09_13:29:45.763681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:47.744038 run osmo-stp_10.42.42.5(pid=10509): stderr: | 20221209132946037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132946038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132946038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132946038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132946039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132946039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132946039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:47.880738 run osmo-stp_10.42.42.5(pid=10509): stdout: | (launched: 2022-12-09_13:29:45.763681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:48.011928 run osmo-stp_10.42.42.5(pid=10509): stderr: | 20221209132946037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132946038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132946038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132946038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132946039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132946039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132946039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:48.167342 run patchelf(pid=10512): Terminating (SIGINT) 13:29:48.346086 run patchelf(pid=10512): Terminated: ok {rc=0} 13:29:48.474684 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10509): Process ended prematurely: osmo-stp_10.42.42.5(pid=10509) [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10509)] [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 13:29:48.484913 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 13:29:48.514398 run osmo-hlr_10.42.42.2(pid=10506): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10506)] 13:29:48.565127 run osmo-hlr_10.42.42.2(pid=10506): stdout: | (launched: 2022-12-09_13:29:44.766529) 13:29:48.618026 run osmo-hlr_10.42.42.2(pid=10506): stderr: | 20221209132944967 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132944967 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132944967 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132944967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132944967 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132944967 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132944979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132944987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132944987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132944987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:48.671649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10499): Terminating (SIGTERM) 13:29:48.714351 run iperf3-srv_10.42.42.10(pid=10500): Terminating (SIGTERM) 13:29:48.756718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10501): Terminating (SIGTERM) 13:29:48.799298 run iperf3-srv_10.42.42.10(pid=10502): Terminating (SIGTERM) 13:29:48.841760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10505): Terminating (SIGTERM) 13:29:48.884219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10508): Terminating (SIGTERM) 13:29:48.926796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10511): Terminating (SIGTERM) 13:29:48.969334 --- ParallelTerminationStrategy: PID 10499 died... 13:29:48.989276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10499): Terminated: ok {rc=0} 13:29:49.036391 --- ParallelTerminationStrategy: PID 10500 died... 13:29:49.056185 run iperf3-srv_10.42.42.10(pid=10500): Terminated {rc=256} 13:29:49.102816 --- ParallelTerminationStrategy: PID 10501 died... 13:29:49.122468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10501): Terminated: ok {rc=0} 13:29:49.169189 --- ParallelTerminationStrategy: PID 10502 died... 13:29:49.188713 run iperf3-srv_10.42.42.10(pid=10502): Terminated {rc=256} 13:29:49.235245 --- ParallelTerminationStrategy: PID 10505 died... 13:29:49.254803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10505): Terminated: ok {rc=0} 13:29:49.301677 --- ParallelTerminationStrategy: PID 10508 died... 13:29:49.321509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10508): Terminated: ok {rc=0} 13:29:49.368589 --- ParallelTerminationStrategy: PID 10511 died... 13:29:49.388512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10511): Terminated: ok {rc=0} 13:29:49.476436 bus /gobi_0: Setting Powered False 13:29:50.577834 bus /gobi_0: Setting Powered False 13:29:51.695351 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 13:29:52.843638 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:52.856260 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:29:52.916479 tst iperf3.py: using LAC 21784 13:29:53.041584 tst iperf3.py: using RAC 109 13:29:53.166326 tst iperf3.py: using CellId 21784 13:29:53.294469 tst iperf3.py: using BVCI 21785 13:29:53.411964 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:53.423787 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:53.435223 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:53.447087 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:53.458868 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:53.470651 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:53.482517 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:53.494121 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:29:53.506062 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:29:53.623904 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:29:53.838160 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:29:54.158374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10513): Launched 13:29:54.436150 run iperf3-srv_10.42.42.10(pid=10514): Launched 13:29:54.555745 tst iperf3.py:8: start network... 13:29:54.770154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:55.264638 run create_hlr_db(pid=10515): Launched 13:29:55.388461 bus /gobi_6: Setting Powered False 13:29:56.451815 run create_hlr_db(pid=10515): Terminated: ok {rc=0} 13:29:56.895401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10517): Launched 13:29:57.214539 run osmo-hlr_10.42.42.2(pid=10518): Launched 13:29:57.336539 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:57.887039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10520): Launched 13:29:58.205577 run osmo-stp_10.42.42.5(pid=10521): Launched 13:29:58.328165 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:29:58.878564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10523): Launched 13:29:59.000434 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:29:59.269691 run patchelf(pid=10524): Launched 13:29:59.448098 run osmo-stp_10.42.42.5(pid=10521): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10521)] 13:29:59.583634 run osmo-stp_10.42.42.5(pid=10521): stdout: | (launched: 2022-12-09_13:29:58.147104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:59.720857 run osmo-stp_10.42.42.5(pid=10521): stderr: | 20221209132958338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132958338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132958339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132958339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132958340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132958340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132958340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:59.857828 run osmo-stp_10.42.42.5(pid=10521): stdout: | (launched: 2022-12-09_13:29:58.147104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:59.989041 run osmo-stp_10.42.42.5(pid=10521): stderr: | 20221209132958338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209132958338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209132958339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209132958339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209132958340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209132958340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209132958340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:00.144277 run patchelf(pid=10524): Terminating (SIGINT) 13:30:00.323187 run patchelf(pid=10524): Terminated: ok {rc=0} 13:30:00.452247 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10521): Process ended prematurely: osmo-stp_10.42.42.5(pid=10521) [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10521)] [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 13:30:00.462571 tst iperf3.py:8: Test FAILED (7.7 sec) 13:30:00.491728 run osmo-hlr_10.42.42.2(pid=10518): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10518)] 13:30:00.542413 run osmo-hlr_10.42.42.2(pid=10518): stdout: | (launched: 2022-12-09_13:29:57.155871) 13:30:00.594618 run osmo-hlr_10.42.42.2(pid=10518): stderr: | 20221209132957354 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209132957354 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209132957354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209132957354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209132957354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209132957354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209132957377 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209132957387 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209132957387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209132957387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:00.647312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10513): Terminating (SIGTERM) 13:30:00.689756 run iperf3-srv_10.42.42.10(pid=10514): Terminating (SIGTERM) 13:30:00.731910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10517): Terminating (SIGTERM) 13:30:00.774410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10520): Terminating (SIGTERM) 13:30:00.816791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10523): Terminating (SIGTERM) 13:30:00.860009 --- ParallelTerminationStrategy: PID 10513 died... 13:30:00.880248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10513): Terminated: ok {rc=0} 13:30:00.928011 --- ParallelTerminationStrategy: PID 10514 died... 13:30:00.948211 run iperf3-srv_10.42.42.10(pid=10514): Terminated {rc=256} 13:30:00.995635 --- ParallelTerminationStrategy: PID 10517 died... 13:30:01.015789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10517): Terminated: ok {rc=0} 13:30:01.063403 --- ParallelTerminationStrategy: PID 10520 died... 13:30:01.083403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10520): Terminated: ok {rc=0} 13:30:01.131063 --- ParallelTerminationStrategy: PID 10523 died... 13:30:01.151262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10523): Terminated: ok {rc=0} 13:30:01.240521 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 13:30:02.388223 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:02.400676 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:30:02.453489 tst iperf3m4.py: using LAC 21785 13:30:02.572195 tst iperf3m4.py: using RAC 110 13:30:02.691817 tst iperf3m4.py: using CellId 21785 13:30:02.809575 tst iperf3m4.py: using BVCI 21786 13:30:02.918823 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:02.930204 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:02.941387 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:02.953075 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:02.964707 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:02.976294 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:02.987995 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:02.999526 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:03.011422 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:30:03.125774 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:30:03.244280 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:30:03.366106 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:30:03.485671 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:30:03.699910 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:30:04.019520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10528): Launched 13:30:04.296614 run iperf3-srv_10.42.42.10(pid=10529): Launched 13:30:04.417132 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:30:04.631062 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:30:04.950741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10530): Launched 13:30:05.229444 run iperf3-srv_10.42.42.10(pid=10531): Launched 13:30:05.349977 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:30:05.563956 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:30:05.883587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10532): Launched 13:30:06.160578 run iperf3-srv_10.42.42.10(pid=10533): Launched 13:30:06.279838 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:30:06.494115 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:30:06.812860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10534): Launched 13:30:07.089656 run iperf3-srv_10.42.42.10(pid=10535): Launched 13:30:07.209214 tst iperf3m4.py:8: start network... 13:30:07.423700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:07.921412 run create_hlr_db(pid=10536): Launched 13:30:08.042968 bus /gobi_6: Setting Powered False 13:30:09.106244 run create_hlr_db(pid=10536): Terminated: ok {rc=0} 13:30:09.534018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10538): Launched 13:30:09.833699 run osmo-hlr_10.42.42.2(pid=10539): Launched 13:30:09.946830 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:10.466851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10541): Launched 13:30:10.764868 run osmo-stp_10.42.42.5(pid=10542): Launched 13:30:10.879170 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:30:11.395706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10544): Launched 13:30:11.509549 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:30:11.762627 run patchelf(pid=10545): Launched 13:30:11.928812 run osmo-stp_10.42.42.5(pid=10542): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10542)] 13:30:12.055775 run osmo-stp_10.42.42.5(pid=10542): stdout: | (launched: 2022-12-09_13:30:10.710210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:12.184445 run osmo-stp_10.42.42.5(pid=10542): stderr: | 20221209133010877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133010877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133010878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133010878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133010879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133010879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133010879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:12.312645 run osmo-stp_10.42.42.5(pid=10542): stdout: | (launched: 2022-12-09_13:30:10.710210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:12.435590 run osmo-stp_10.42.42.5(pid=10542): stderr: | 20221209133010877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133010877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133010878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133010878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133010879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133010879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133010879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:12.581182 run patchelf(pid=10545): Terminating (SIGINT) 13:30:12.748178 run patchelf(pid=10545): Terminated: ok {rc=0} 13:30:12.868433 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10542): Process ended prematurely: osmo-stp_10.42.42.5(pid=10542) [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10542)] [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 13:30:12.878467 tst iperf3m4.py:8: Test FAILED (10.5 sec) 13:30:12.905943 run osmo-hlr_10.42.42.2(pid=10539): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10539)] 13:30:12.953434 run osmo-hlr_10.42.42.2(pid=10539): stdout: | (launched: 2022-12-09_13:30:09.778324) 13:30:13.002651 run osmo-hlr_10.42.42.2(pid=10539): stderr: | 20221209133009954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133009954 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133009954 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133009954 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133009954 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133009954 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133009966 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133009975 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133009975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133009975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:13.052215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10528): Terminating (SIGTERM) 13:30:13.092108 run iperf3-srv_10.42.42.10(pid=10529): Terminating (SIGTERM) 13:30:13.131871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10530): Terminating (SIGTERM) 13:30:13.171633 run iperf3-srv_10.42.42.10(pid=10531): Terminating (SIGTERM) 13:30:13.211060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10532): Terminating (SIGTERM) 13:30:13.250777 run iperf3-srv_10.42.42.10(pid=10533): Terminating (SIGTERM) 13:30:13.290223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10534): Terminating (SIGTERM) 13:30:13.329794 run iperf3-srv_10.42.42.10(pid=10535): Terminating (SIGTERM) 13:30:13.369337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10538): Terminating (SIGTERM) 13:30:13.409346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10541): Terminating (SIGTERM) 13:30:13.448907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10544): Terminating (SIGTERM) 13:30:13.488720 --- ParallelTerminationStrategy: PID 10528 died... 13:30:13.507809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10528): Terminated: ok {rc=0} 13:30:13.551560 --- ParallelTerminationStrategy: PID 10529 died... 13:30:13.570155 run iperf3-srv_10.42.42.10(pid=10529): Terminated {rc=256} 13:30:13.614469 --- ParallelTerminationStrategy: PID 10530 died... 13:30:13.633195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10530): Terminated: ok {rc=0} 13:30:13.676882 --- ParallelTerminationStrategy: PID 10531 died... 13:30:13.695904 run iperf3-srv_10.42.42.10(pid=10531): Terminated {rc=256} 13:30:13.739374 --- ParallelTerminationStrategy: PID 10532 died... 13:30:13.757932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10532): Terminated: ok {rc=0} 13:30:13.801414 --- ParallelTerminationStrategy: PID 10533 died... 13:30:13.819902 run iperf3-srv_10.42.42.10(pid=10533): Terminated {rc=256} 13:30:13.863354 --- ParallelTerminationStrategy: PID 10534 died... 13:30:13.881959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10534): Terminated: ok {rc=0} 13:30:13.925600 --- ParallelTerminationStrategy: PID 10535 died... 13:30:13.944106 run iperf3-srv_10.42.42.10(pid=10535): Terminated {rc=256} 13:30:13.987557 --- ParallelTerminationStrategy: PID 10538 died... 13:30:14.006298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10538): Terminated: ok {rc=0} 13:30:14.049856 --- ParallelTerminationStrategy: PID 10541 died... 13:30:14.068195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10541): Terminated: ok {rc=0} 13:30:14.111995 --- ParallelTerminationStrategy: PID 10544 died... 13:30:14.130650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10544): Terminated: ok {rc=0} 13:30:14.214967 bus /gobi_4: Setting Powered False 13:30:15.314475 bus /gobi_4: Setting Powered False 13:30:16.434257 bus /gobi_1: Setting Powered False 13:30:17.548108 bus /gobi_1: Setting Powered False 13:30:18.665022 bus /gobi_0: Setting Powered False 13:30:19.762508 bus /gobi_0: Setting Powered False 13:30:20.880322 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 13:30:21.982770 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:21.995379 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:30:22.050605 tst ping.py: using LAC 21786 13:30:22.174471 tst ping.py: using RAC 111 13:30:22.297911 tst ping.py: using CellId 21786 13:30:22.421786 tst ping.py: using BVCI 21787 13:30:22.535686 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:22.547717 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:22.559501 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:22.571446 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:22.583166 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:22.595131 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:22.607150 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:22.619015 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:30:22.735451 tst ping.py:19: start network... 13:30:22.932154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:23.386446 run create_hlr_db(pid=10546): Launched 13:30:23.506732 bus /gobi_6: Setting Powered False 13:30:24.566548 run create_hlr_db(pid=10546): Terminated: ok {rc=0} 13:30:24.996554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10548): Launched 13:30:25.310848 run osmo-hlr_10.42.42.2(pid=10549): Launched 13:30:25.431136 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:25.976720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10551): Launched 13:30:26.291315 run osmo-stp_10.42.42.5(pid=10552): Launched 13:30:26.411331 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:30:26.953999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10554): Launched 13:30:27.076277 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:30:27.341757 run patchelf(pid=10555): Launched 13:30:27.518263 run osmo-stp_10.42.42.5(pid=10552): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10552)] 13:30:27.651943 run osmo-stp_10.42.42.5(pid=10552): stdout: | (launched: 2022-12-09_13:30:26.233632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:27.787147 run osmo-stp_10.42.42.5(pid=10552): stderr: | 20221209133026424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133026425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133026425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133026425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133026426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133026426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133026426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:27.922348 run osmo-stp_10.42.42.5(pid=10552): stdout: | (launched: 2022-12-09_13:30:26.233632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:28.051849 run osmo-stp_10.42.42.5(pid=10552): stderr: | 20221209133026424 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133026425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133026425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133026425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133026426 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133026426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133026426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:28.204909 run patchelf(pid=10555): Terminating (SIGINT) 13:30:28.381448 run patchelf(pid=10555): Terminated: ok {rc=0} 13:30:28.507839 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10552): Process ended prematurely: osmo-stp_10.42.42.5(pid=10552) [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10552)] [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 13:30:28.517415 tst ping.py:22: Test FAILED (6.5 sec) 13:30:28.546231 run osmo-hlr_10.42.42.2(pid=10549): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10549)] 13:30:28.596932 run osmo-hlr_10.42.42.2(pid=10549): stdout: | (launched: 2022-12-09_13:30:25.253720) 13:30:28.649665 run osmo-hlr_10.42.42.2(pid=10549): stderr: | 20221209133025448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133025448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133025448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133025448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133025448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133025448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133025461 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133025469 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133025469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133025469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:28.702535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10548): Terminating (SIGTERM) 13:30:28.744815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10551): Terminating (SIGTERM) 13:30:28.787299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10554): Terminating (SIGTERM) 13:30:28.829908 --- ParallelTerminationStrategy: PID 10548 died... 13:30:28.850066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10548): Terminated: ok {rc=0} 13:30:28.897133 --- ParallelTerminationStrategy: PID 10551 died... 13:30:28.916815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10551): Terminated: ok {rc=0} 13:30:28.963620 --- ParallelTerminationStrategy: PID 10554 died... 13:30:28.983490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10554): Terminated: ok {rc=0} 13:30:29.072646 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 13:30:30.160642 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:30.173363 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:30:30.228763 tst ping_idle_ping.py: using LAC 21787 13:30:30.353639 tst ping_idle_ping.py: using RAC 112 13:30:30.476389 tst ping_idle_ping.py: using CellId 21787 13:30:30.591829 tst ping_idle_ping.py: using BVCI 21788 13:30:30.699482 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:30.711005 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:30.722263 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:30.734006 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:30.745798 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:30.757452 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:30.769342 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:30:30.780893 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:30:30.928683 tst ping_idle_ping.py:24: start network... 13:30:31.139606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:31.606544 run create_hlr_db(pid=10556): Launched 13:30:31.760758 bus /gobi_6: Setting Powered False 13:30:32.819889 run create_hlr_db(pid=10556): Terminated: ok {rc=0} 13:30:33.232190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10558): Launched 13:30:33.525771 run osmo-hlr_10.42.42.2(pid=10559): Launched 13:30:33.636622 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:34.155490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10561): Launched 13:30:34.447739 run osmo-stp_10.42.42.5(pid=10562): Launched 13:30:34.558346 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:30:35.064612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10564): Launched 13:30:35.177200 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:30:35.424609 run patchelf(pid=10565): Launched 13:30:35.587363 run osmo-stp_10.42.42.5(pid=10562): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10562)] 13:30:35.711595 run osmo-stp_10.42.42.5(pid=10562): stdout: | (launched: 2022-12-09_13:30:34.393544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:35.837528 run osmo-stp_10.42.42.5(pid=10562): stderr: | 20221209133034563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133034563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133034563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133034564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133034564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133034564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133034564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:35.963507 run osmo-stp_10.42.42.5(pid=10562): stdout: | (launched: 2022-12-09_13:30:34.393544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:36.083424 run osmo-stp_10.42.42.5(pid=10562): stderr: | 20221209133034563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133034563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133034563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133034564 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133034564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133034564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133034564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:36.230186 run patchelf(pid=10565): Terminating (SIGINT) 13:30:36.406130 run patchelf(pid=10565): Terminated: ok {rc=0} 13:30:36.532854 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10562): Process ended prematurely: osmo-stp_10.42.42.5(pid=10562) [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10562)] [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 13:30:36.542655 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:30:36.571341 run osmo-hlr_10.42.42.2(pid=10559): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10559)] 13:30:36.621840 run osmo-hlr_10.42.42.2(pid=10559): stdout: | (launched: 2022-12-09_13:30:33.471308) 13:30:36.673893 run osmo-hlr_10.42.42.2(pid=10559): stderr: | 20221209133033645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133033645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133033645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133033645 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133033645 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133033645 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133033656 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133033665 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133033665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133033665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:36.726288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10558): Terminating (SIGTERM) 13:30:36.768125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10561): Terminating (SIGTERM) 13:30:36.810412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10564): Terminating (SIGTERM) 13:30:36.852709 --- ParallelTerminationStrategy: PID 10558 died... 13:30:36.872891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10558): Terminated: ok {rc=0} 13:30:36.919385 --- ParallelTerminationStrategy: PID 10561 died... 13:30:36.938832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10561): Terminated: ok {rc=0} 13:30:36.985262 --- ParallelTerminationStrategy: PID 10564 died... 13:30:37.004564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10564): Terminated: ok {rc=0} 13:30:37.092491 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:30:38.404366 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:30:38.413339 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:30:38.447480 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:30:38.482970 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:30:38.538434 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:30:38.571602 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:30:38.607020 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:30:39.169439 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2360 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:30:39.175225 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:30:39.186987 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:30:39.257376 tst switch_tch_pdch.py: using LAC 21788 13:30:39.375197 tst switch_tch_pdch.py: using RAC 113 13:30:39.492620 tst switch_tch_pdch.py: using CellId 21788 13:30:39.607874 tst switch_tch_pdch.py: using BVCI 21789 13:30:39.724574 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:30:39.736288 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:30:39.747871 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:30:39.759782 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:30:39.771761 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:30:39.783506 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:30:39.796030 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:30:39.807671 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:30:39.927584 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:30:40.041276 tst switch_tch_pdch.py:51: start network... 13:30:40.235454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:40.687571 run create_hlr_db(pid=10569): Launched 13:30:40.806852 bus /gobi_6: Setting Powered False 13:30:41.866357 run create_hlr_db(pid=10569): Terminated: ok {rc=0} 13:30:42.295118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10571): Launched 13:30:42.609253 run osmo-hlr_10.42.42.2(pid=10572): Launched 13:30:42.729120 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:43.270927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10575): Launched 13:30:43.582539 run osmo-stp_10.42.42.5(pid=10576): Launched 13:30:43.700643 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:30:44.239500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10578): Launched 13:30:44.360126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:30:44.624650 run patchelf(pid=10579): Launched 13:30:44.797806 run osmo-stp_10.42.42.5(pid=10576): ERR: Terminated: ERROR {rc=1} [trial-2360↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10576)] 13:30:44.930717 run osmo-stp_10.42.42.5(pid=10576): stdout: | (launched: 2022-12-09_13:30:43.525584) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:45.064684 run osmo-stp_10.42.42.5(pid=10576): stderr: | 20221209133043715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133043715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133043715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133043716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133043716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133043716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133043716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:45.199429 run osmo-stp_10.42.42.5(pid=10576): stdout: | (launched: 2022-12-09_13:30:43.525584) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:45.328351 run osmo-stp_10.42.42.5(pid=10576): stderr: | 20221209133043715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133043715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133043715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133043716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133043716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133043716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133043716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:45.480629 run patchelf(pid=10579): Terminating (SIGINT) 13:30:45.654982 run patchelf(pid=10579): Terminated: ok {rc=0} 13:30:45.780751 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10576): Process ended prematurely: osmo-stp_10.42.42.5(pid=10576) [trial-2360↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10576)] [trial-2360↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:30:45.790410 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 13:30:45.818876 run osmo-hlr_10.42.42.2(pid=10572): ERR: Terminated: ERROR {rc=237} [trial-2360↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10572)] 13:30:45.871301 run osmo-hlr_10.42.42.2(pid=10572): stdout: | (launched: 2022-12-09_13:30:42.551673) 13:30:45.938781 run osmo-hlr_10.42.42.2(pid=10572): stderr: | 20221209133042748 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133042748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133042748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133042749 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133042749 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133042749 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133042764 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133042774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133042774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133042774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:45.993433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10571): Terminating (SIGTERM) 13:30:46.037098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10575): Terminating (SIGTERM) 13:30:46.085165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10578): Terminating (SIGTERM) 13:30:46.131143 --- ParallelTerminationStrategy: PID 10571 died... 13:30:46.151140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10571): Terminated: ok {rc=0} 13:30:46.199642 --- ParallelTerminationStrategy: PID 10575 died... 13:30:46.219191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10575): Terminated: ok {rc=0} 13:30:46.265691 --- ParallelTerminationStrategy: PID 10578 died... 13:30:46.285404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10578): Terminated: ok {rc=0} 13:30:46.376063 bus /gobi_0: Setting Powered False 13:30:47.474612 bus /gobi_0: Setting Powered False 13:30:48.589180 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:30:49.839690 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:30:49.845423 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:30:49.877655 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:30:49.912198 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:30:49.966529 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:30:49.998951 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:30:50.033101 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:30:50.590533 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2360 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:30:50.596058 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:30:50.607466 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:30:50.678819 tst switch_tch_pdch.py: using LAC 21789 13:30:50.801612 tst switch_tch_pdch.py: using RAC 114 13:30:50.926504 tst switch_tch_pdch.py: using CellId 21789 13:30:51.047957 tst switch_tch_pdch.py: using BVCI 21790 13:30:51.161447 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:30:51.172825 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:30:51.184069 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:30:51.195619 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:30:51.207025 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:30:51.218390 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:30:51.229912 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:30:51.241308 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:30:51.356736 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:30:51.471575 tst switch_tch_pdch.py:51: start network... 13:30:51.664935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:52.089746 run create_hlr_db(pid=10583): Launched 13:30:52.209688 bus /gobi_6: Setting Powered False 13:30:53.268486 run create_hlr_db(pid=10583): Terminated: ok {rc=0} 13:30:53.668902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10585): Launched 13:30:53.980708 run osmo-hlr_10.42.42.2(pid=10586): Launched 13:30:54.099643 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:54.613545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10588): Launched 13:30:54.924714 run osmo-stp_10.42.42.5(pid=10589): Launched 13:30:55.043024 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:30:55.554433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10591): Launched 13:30:55.674161 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:30:55.938529 run patchelf(pid=10592): Launched 13:30:56.112865 run osmo-stp_10.42.42.5(pid=10589): ERR: Terminated: ERROR {rc=1} [trial-2360↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10589)] 13:30:56.246137 run osmo-stp_10.42.42.5(pid=10589): stdout: | (launched: 2022-12-09_13:30:54.868067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:56.381813 run osmo-stp_10.42.42.5(pid=10589): stderr: | 20221209133055055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133055055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133055055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133055056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133055056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133055056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133055056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:56.517223 run osmo-stp_10.42.42.5(pid=10589): stdout: | (launched: 2022-12-09_13:30:54.868067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:56.646602 run osmo-stp_10.42.42.5(pid=10589): stderr: | 20221209133055055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133055055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133055055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133055056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133055056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133055056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133055056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:56.799605 run patchelf(pid=10592): Terminating (SIGINT) 13:30:56.974878 run patchelf(pid=10592): Terminated: ok {rc=0} 13:30:57.101467 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10589): Process ended prematurely: osmo-stp_10.42.42.5(pid=10589) [trial-2360↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10589)] [trial-2360↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:30:57.111085 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 13:30:57.139290 run osmo-hlr_10.42.42.2(pid=10586): ERR: Terminated: ERROR {rc=237} [trial-2360↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10586)] 13:30:57.189820 run osmo-hlr_10.42.42.2(pid=10586): stdout: | (launched: 2022-12-09_13:30:53.923915) 13:30:57.242049 run osmo-hlr_10.42.42.2(pid=10586): stderr: | 20221209133054120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133054120 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133054120 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133054120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133054120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133054121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133054136 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133054146 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133054147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133054147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:57.294950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10585): Terminating (SIGTERM) 13:30:57.337780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10588): Terminating (SIGTERM) 13:30:57.380375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10591): Terminating (SIGTERM) 13:30:57.422861 --- ParallelTerminationStrategy: PID 10585 died... 13:30:57.442887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10585): Terminated: ok {rc=0} 13:30:57.489607 --- ParallelTerminationStrategy: PID 10588 died... 13:30:57.509145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10588): Terminated: ok {rc=0} 13:30:57.555851 --- ParallelTerminationStrategy: PID 10591 died... 13:30:57.575441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10591): Terminated: ok {rc=0} 13:30:57.663069 bus /gobi_0: Setting Powered False 13:30:58.763927 bus /gobi_0: Setting Powered False 13:30:59.880530 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_sms:trx-lms --------------------------------------------------------------------- 13:31:01.146021 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:31:01.149735 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 13:31:01.183030 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 13:31:01.190128 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 13:31:01.241486 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 13:31:01.277951 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 13:31:01.286137 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 13:31:01.834551 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 13:31:01.842083 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 13:31:01.857850 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 13:31:01.919704 tst mo_mt_sms.py: using LAC 21790 13:31:02.069227 tst mo_mt_sms.py: using RAC 115 13:31:02.201189 tst mo_mt_sms.py: using CellId 21790 13:31:02.325359 tst mo_mt_sms.py: using BVCI 21791 13:31:02.440313 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 13:31:02.557680 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 13:31:02.670810 tst mo_mt_sms.py:9: start nitb and bts... 13:31:02.867332 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:31:03.465607 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10596): Launched 13:31:03.758073 run osmo-nitb_10.42.42.2(pid=10597): Launched 13:31:03.922374 run osmo-nitb_10.42.42.2(pid=10597): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10597)] 13:31:04.053942 run osmo-nitb_10.42.42.2(pid=10597): stdout: | (launched: 2022-12-09_13:31:03.704601) 13:31:04.187133 run osmo-nitb_10.42.42.2(pid=10597): stderr: | (launched: 2022-12-09_13:31:03.748096) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:31:04.320082 run osmo-nitb_10.42.42.2(pid=10597): stdout: | (launched: 2022-12-09_13:31:03.704601) 13:31:04.447711 run osmo-nitb_10.42.42.2(pid=10597): stderr: | (launched: 2022-12-09_13:31:03.748096) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10597): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10597) [trial-2360↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10597)] 13:31:04.870821 tst osmo-nitb_10.42.42.2(pid=10597): stdout: | (launched: 2022-12-09_13:31:03.704601) 13:31:04.988756 tst osmo-nitb_10.42.42.2(pid=10597): stderr: | (launched: 2022-12-09_13:31:03.748096) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:31:05.127675 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=10597): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10597) [trial-2360↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10597)] [trial-2360↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 13:31:05.135955 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 13:31:05.142418 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10596): Terminating (SIGTERM) 13:31:05.350653 --- ParallelTerminationStrategy: PID 10596 died... 13:31:05.371294 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10596): Terminated: ok {rc=0} 13:31:05.456939 bus /sierra_3: Setting Powered False 13:31:06.556700 bus /sierra_3: Setting Powered False 13:31:07.672380 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 sms:trx-lms --------------------------------------------------------------------- 13:31:08.869854 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:31:08.874164 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 13:31:08.910370 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 13:31:08.938288 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 13:31:08.991386 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 13:31:09.025378 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 13:31:09.052828 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 13:31:09.598749 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 13:31:09.604092 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:31:09.614990 tst sms:trx-lms: Using 1 x bts (candidates: 1) 13:31:09.664031 tst mo_mt_sms.py: using LAC 21791 13:31:09.786267 tst mo_mt_sms.py: using RAC 116 13:31:09.908677 tst mo_mt_sms.py: using CellId 21791 13:31:10.023857 tst mo_mt_sms.py: using BVCI 21792 13:31:10.129270 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:31:10.139571 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:31:10.150187 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:31:10.160466 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:31:10.170706 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:31:10.180916 tst sms:trx-lms: Using 1 x modem (candidates: 2) 13:31:10.298312 tst sms:trx-lms: Using 1 x modem (candidates: 2) 13:31:10.416541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:10.868747 run create_hlr_db(pid=10602): Launched 13:31:10.988123 bus /sierra_2: Setting Powered False 13:31:12.046413 run create_hlr_db(pid=10602): Terminated: ok {rc=0} 13:31:12.476172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10604): Launched 13:31:12.788565 run osmo-hlr_10.42.42.2(pid=10605): Launched 13:31:12.907439 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:13.450402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10607): Launched 13:31:13.762014 run osmo-stp_10.42.42.5(pid=10608): Launched 13:31:13.880120 run osmo-msc_10.42.42.6: Starting osmo-msc 13:31:14.445734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10610): Launched 13:31:14.757089 run osmo-msc_10.42.42.6(pid=10611): Launched 13:31:14.930811 run osmo-stp_10.42.42.5(pid=10608): ERR: Terminated: ERROR {rc=1} [trial-2360↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10608)] 13:31:15.062459 run osmo-stp_10.42.42.5(pid=10608): stdout: | (launched: 2022-12-09_13:31:13.705330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:15.195841 run osmo-stp_10.42.42.5(pid=10608): stderr: | 20221209133113894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133113894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133113895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133113895 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133113896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133113896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133113896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:15.328938 run osmo-stp_10.42.42.5(pid=10608): stdout: | (launched: 2022-12-09_13:31:13.705330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:15.454057 run osmo-stp_10.42.42.5(pid=10608): stderr: | 20221209133113894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133113894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133113895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133113895 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133113896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133113896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133113896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:15.602810 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=10608): Process ended prematurely: osmo-stp_10.42.42.5(pid=10608) [trial-2360↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10608)] [trial-2360↪sms:trx-lms↪mo_mt_sms.py:16] 13:31:15.611738 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 13:31:15.639153 run osmo-hlr_10.42.42.2(pid=10605): ERR: Terminated: ERROR {rc=237} [trial-2360↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10605)] 13:31:15.689637 run osmo-hlr_10.42.42.2(pid=10605): stdout: | (launched: 2022-12-09_13:31:12.731654) 13:31:15.741523 run osmo-hlr_10.42.42.2(pid=10605): stderr: | 20221209133112928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133112928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133112928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133112928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133112928 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133112928 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133112941 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133112949 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133112949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133112949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:15.813569 run osmo-msc_10.42.42.6(pid=10611): ERR: Terminated: ERROR {rc=2} [trial-2360↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10611)] 13:31:15.864713 run osmo-msc_10.42.42.6(pid=10611): stdout: | (launched: 2022-12-09_13:31:14.699528) 13:31:15.936092 run osmo-msc_10.42.42.6(pid=10611): stderr: | 20221209133115021 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133115021 DLGLOBAL DEBUG validating counter group 0x7f6241ef0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133115021 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133115022 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133115022 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133115022 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133115024 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133115024 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133115024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133115024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:31:15.991714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10604): Terminating (SIGTERM) 13:31:16.033732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10607): Terminating (SIGTERM) 13:31:16.076920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10610): Terminating (SIGTERM) 13:31:16.121950 --- ParallelTerminationStrategy: PID 10604 died... 13:31:16.141854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10604): Terminated: ok {rc=0} 13:31:16.188625 --- ParallelTerminationStrategy: PID 10607 died... 13:31:16.208559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10607): Terminated: ok {rc=0} 13:31:16.254244 --- ParallelTerminationStrategy: PID 10610 died... 13:31:16.274004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10610): Terminated: ok {rc=0} 13:31:16.360083 bus /sierra_3: Setting Powered False 13:31:17.458041 bus /sierra_3: Setting Powered False 13:31:18.573091 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_ussd:trx-lms --------------------------------------------------------------------- 13:31:19.804700 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:31:19.808820 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 13:31:19.844040 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 13:31:19.851170 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 13:31:19.888300 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 13:31:19.925503 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 13:31:19.932696 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 13:31:20.446844 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2360 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 13:31:20.452226 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 13:31:20.463492 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 13:31:20.513127 tst assert_extension.py: using LAC 21792 13:31:20.639323 tst assert_extension.py: using RAC 117 13:31:20.761579 tst assert_extension.py: using CellId 21792 13:31:20.881907 tst assert_extension.py: using BVCI 21793 13:31:20.995048 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 13:31:21.107391 tst assert_extension.py:10: start nitb and bts... 13:31:21.302492 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:31:21.902911 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10616): Launched 13:31:22.194765 run osmo-nitb_10.42.42.2(pid=10617): Launched 13:31:22.356237 run osmo-nitb_10.42.42.2(pid=10617): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10617)] 13:31:22.487670 run osmo-nitb_10.42.42.2(pid=10617): stdout: | (launched: 2022-12-09_13:31:22.141230) 13:31:22.620931 run osmo-nitb_10.42.42.2(pid=10617): stderr: | (launched: 2022-12-09_13:31:22.184675) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:31:22.754025 run osmo-nitb_10.42.42.2(pid=10617): stdout: | (launched: 2022-12-09_13:31:22.141230) 13:31:22.881820 run osmo-nitb_10.42.42.2(pid=10617): stderr: | (launched: 2022-12-09_13:31:22.184675) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10617): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10617) [trial-2360↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10617)] 13:31:23.304515 tst osmo-nitb_10.42.42.2(pid=10617): stdout: | (launched: 2022-12-09_13:31:22.141230) 13:31:23.422450 tst osmo-nitb_10.42.42.2(pid=10617): stderr: | (launched: 2022-12-09_13:31:22.184675) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:31:23.562104 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=10617): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10617) [trial-2360↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10617)] [trial-2360↪nitb_ussd:trx-lms↪assert_extension.py:12] 13:31:23.570496 tst assert_extension.py:12: Test FAILED (3.1 sec) 13:31:23.576857 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10616): Terminating (SIGTERM) 13:31:23.785214 --- ParallelTerminationStrategy: PID 10616 died... 13:31:23.805461 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10616): Terminated: ok {rc=0} 13:31:23.890901 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 ussd:trx-lms --------------------------------------------------------------------- 13:31:25.066571 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:31:25.070706 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 13:31:25.103631 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 13:31:25.130114 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 13:31:25.164923 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 13:31:25.197410 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 13:31:25.223617 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 13:31:25.752194 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2360 ussd:trx-lms assert_extension.py ---------------------------------------------- 13:31:25.757112 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:31:25.767489 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 13:31:25.817257 tst assert_extension.py: using LAC 21793 13:31:25.931655 tst assert_extension.py: using RAC 118 13:31:26.044337 tst assert_extension.py: using CellId 21793 13:31:26.157626 tst assert_extension.py: using BVCI 21794 13:31:26.262536 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:31:26.273029 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:31:26.283379 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:31:26.293693 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:31:26.303944 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:31:26.314361 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 13:31:26.426989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:26.878828 run create_hlr_db(pid=10622): Launched 13:31:26.998373 bus /sierra_2: Setting Powered False 13:31:28.057190 run create_hlr_db(pid=10622): Terminated: ok {rc=0} 13:31:28.486241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10624): Launched 13:31:28.800245 run osmo-hlr_10.42.42.2(pid=10625): Launched 13:31:28.919740 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:29.461662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10627): Launched 13:31:29.773443 run osmo-stp_10.42.42.5(pid=10628): Launched 13:31:29.892747 run osmo-msc_10.42.42.6: Starting osmo-msc 13:31:30.457668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10630): Launched 13:31:30.770368 run osmo-msc_10.42.42.6(pid=10631): Launched 13:31:31.111460 run osmo-stp_10.42.42.5(pid=10628): ERR: Terminated: ERROR {rc=1} [trial-2360↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10628)] 13:31:31.404677 run osmo-stp_10.42.42.5(pid=10628): stdout: | (launched: 2022-12-09_13:31:29.715684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:31.596525 run osmo-stp_10.42.42.5(pid=10628): stderr: | 20221209133129906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133129906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133129906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133129907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133129908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133129909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133129909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:31.727194 run osmo-stp_10.42.42.5(pid=10628): stdout: | (launched: 2022-12-09_13:31:29.715684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:31.847042 run osmo-stp_10.42.42.5(pid=10628): stderr: | 20221209133129906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133129906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133129906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133129907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133129908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133129909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133129909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:31.992035 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=10628): Process ended prematurely: osmo-stp_10.42.42.5(pid=10628) [trial-2360↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10628)] [trial-2360↪ussd:trx-lms↪assert_extension.py:17] 13:31:32.001711 tst assert_extension.py:17: Test FAILED (6.2 sec) 13:31:32.029655 run osmo-hlr_10.42.42.2(pid=10625): ERR: Terminated: ERROR {rc=237} [trial-2360↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10625)] 13:31:32.078509 run osmo-hlr_10.42.42.2(pid=10625): stdout: | (launched: 2022-12-09_13:31:28.743418) 13:31:32.129993 run osmo-hlr_10.42.42.2(pid=10625): stderr: | 20221209133128941 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133128941 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133128941 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133128942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133128942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133128942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133128952 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133128960 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133128961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133128961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:32.200920 run osmo-msc_10.42.42.6(pid=10631): ERR: Terminated: ERROR {rc=2} [trial-2360↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10631)] 13:31:32.249441 run osmo-msc_10.42.42.6(pid=10631): stdout: | (launched: 2022-12-09_13:31:30.713316) 13:31:32.299648 run osmo-msc_10.42.42.6(pid=10631): stderr: | 20221209133131152 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133131152 DLGLOBAL DEBUG validating counter group 0x7fd449f78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133131154 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133131154 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133131154 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133131154 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133131157 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133131158 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133131158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133131159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:31:32.351428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10624): Terminating (SIGTERM) 13:31:32.392232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10627): Terminating (SIGTERM) 13:31:32.435677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10630): Terminating (SIGTERM) 13:31:32.476606 --- ParallelTerminationStrategy: PID 10624 died... 13:31:32.495499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10624): Terminated: ok {rc=0} 13:31:32.544753 --- ParallelTerminationStrategy: PID 10627 died... 13:31:32.564161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10627): Terminated: ok {rc=0} 13:31:32.611768 --- ParallelTerminationStrategy: PID 10630 died... 13:31:32.631254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10630): Terminated: ok {rc=0} 13:31:32.721089 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:31:33.933097 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:31:33.940505 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:31:33.977419 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:31:34.005569 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:31:34.058986 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:31:34.093770 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:31:34.121937 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:31:34.672311 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:31:34.725846 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:31:34.737402 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:31:34.807146 tst mo_mt_call.py: using LAC 21794 13:31:34.930509 tst mo_mt_call.py: using RAC 119 13:31:35.055383 tst mo_mt_call.py: using CellId 21794 13:31:35.172859 tst mo_mt_call.py: using BVCI 21795 13:31:35.280369 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:31:35.291391 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:31:35.302381 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:31:35.313541 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:31:35.324545 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:31:35.335344 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:31:35.447948 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:31:35.564713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:36.026693 run create_hlr_db(pid=10636): Launched 13:31:36.148029 bus /sierra_2: Setting Powered False 13:31:37.208320 run create_hlr_db(pid=10636): Terminated: ok {rc=0} 13:31:37.642945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10638): Launched 13:31:37.962262 run osmo-hlr_10.42.42.2(pid=10639): Launched 13:31:38.083483 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:38.636020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10641): Launched 13:31:38.954095 run osmo-stp_10.42.42.5(pid=10642): Launched 13:31:39.075826 run osmo-msc_10.42.42.6: Starting osmo-msc 13:31:39.655822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10645): Launched 13:31:39.974046 run osmo-msc_10.42.42.6(pid=10646): Launched 13:31:40.151498 run osmo-stp_10.42.42.5(pid=10642): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10642)] 13:31:40.286658 run osmo-stp_10.42.42.5(pid=10642): stdout: | (launched: 2022-12-09_13:31:38.896200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:40.422784 run osmo-stp_10.42.42.5(pid=10642): stderr: | 20221209133139085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133139085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133139085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133139086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133139086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133139086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133139086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:40.557343 run osmo-stp_10.42.42.5(pid=10642): stdout: | (launched: 2022-12-09_13:31:38.896200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:40.684431 run osmo-stp_10.42.42.5(pid=10642): stderr: | 20221209133139085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133139085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133139085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133139086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133139086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133139086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133139086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:40.836831 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10642): Process ended prematurely: osmo-stp_10.42.42.5(pid=10642) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10642)] [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:31:40.846526 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:31:40.874897 run osmo-hlr_10.42.42.2(pid=10639): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10639)] 13:31:40.925358 run osmo-hlr_10.42.42.2(pid=10639): stdout: | (launched: 2022-12-09_13:31:37.903993) 13:31:40.977731 run osmo-hlr_10.42.42.2(pid=10639): stderr: | 20221209133138100 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133138100 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133138100 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133138100 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133138100 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133138100 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133138113 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133138122 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133138122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133138122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:41.050652 run osmo-msc_10.42.42.6(pid=10646): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10646)] 13:31:41.101302 run osmo-msc_10.42.42.6(pid=10646): stdout: | (launched: 2022-12-09_13:31:39.915941) 13:31:41.153608 run osmo-msc_10.42.42.6(pid=10646): stderr: | 20221209133140234 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133140235 DLGLOBAL DEBUG validating counter group 0x7fca134bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133140235 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133140235 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133140235 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133140235 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133140237 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133140237 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133140237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133140237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:31:41.206277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10638): Terminating (SIGTERM) 13:31:41.248465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10641): Terminating (SIGTERM) 13:31:41.290781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10645): Terminating (SIGTERM) 13:31:41.333210 --- ParallelTerminationStrategy: PID 10638 died... 13:31:41.353611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10638): Terminated: ok {rc=0} 13:31:41.400647 --- ParallelTerminationStrategy: PID 10641 died... 13:31:41.420380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10641): Terminated: ok {rc=0} 13:31:41.467508 --- ParallelTerminationStrategy: PID 10645 died... 13:31:41.487179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10645): Terminated: ok {rc=0} 13:31:41.575267 bus /sierra_3: Setting Powered False 13:31:42.675058 bus /sierra_3: Setting Powered False 13:31:43.791663 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:31:44.940712 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:31:44.952755 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:31:45.025421 tst mo_mt_call_osmux.py: using LAC 21795 13:31:45.152585 tst mo_mt_call_osmux.py: using RAC 120 13:31:45.277773 tst mo_mt_call_osmux.py: using CellId 21795 13:31:45.405930 tst mo_mt_call_osmux.py: using BVCI 21796 13:31:45.524131 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:31:45.535685 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:31:45.546988 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:31:45.558596 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:31:45.570239 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:31:45.581779 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:31:45.696839 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:31:45.818051 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:46.351760 run create_hlr_db(pid=10648): Launched 13:31:46.503314 bus /sierra_2: Setting Powered False 13:31:47.563018 run create_hlr_db(pid=10648): Terminated: ok {rc=0} 13:31:47.999120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10650): Launched 13:31:48.318234 run osmo-hlr_10.42.42.2(pid=10651): Launched 13:31:48.442324 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:48.995059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10653): Launched 13:31:49.313861 run osmo-stp_10.42.42.5(pid=10654): Launched 13:31:49.437774 run osmo-msc_10.42.42.6: Starting osmo-msc 13:31:50.014795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10656): Launched 13:31:50.332699 run osmo-msc_10.42.42.6(pid=10657): Launched 13:31:50.510069 run osmo-stp_10.42.42.5(pid=10654): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10654)] 13:31:50.644189 run osmo-stp_10.42.42.5(pid=10654): stdout: | (launched: 2022-12-09_13:31:49.256148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:50.779048 run osmo-stp_10.42.42.5(pid=10654): stderr: | 20221209133149447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133149447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133149447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133149448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133149448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133149449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133149449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:50.913295 run osmo-stp_10.42.42.5(pid=10654): stdout: | (launched: 2022-12-09_13:31:49.256148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:51.040185 run osmo-stp_10.42.42.5(pid=10654): stderr: | 20221209133149447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133149447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133149447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133149448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133149448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133149449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133149449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:51.191873 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10654): Process ended prematurely: osmo-stp_10.42.42.5(pid=10654) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10654)] [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:31:51.201437 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:31:51.229319 run osmo-hlr_10.42.42.2(pid=10651): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10651)] 13:31:51.279703 run osmo-hlr_10.42.42.2(pid=10651): stdout: | (launched: 2022-12-09_13:31:48.260265) 13:31:51.331535 run osmo-hlr_10.42.42.2(pid=10651): stderr: | 20221209133148456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133148456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133148456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133148456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133148456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133148456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133148471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133148481 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133148481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133148481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:51.404129 run osmo-msc_10.42.42.6(pid=10657): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10657)] 13:31:51.454310 run osmo-msc_10.42.42.6(pid=10657): stdout: | (launched: 2022-12-09_13:31:50.274297) 13:31:51.505983 run osmo-msc_10.42.42.6(pid=10657): stderr: | 20221209133150595 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133150595 DLGLOBAL DEBUG validating counter group 0x7ff37ed66c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133150595 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133150595 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133150596 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133150596 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133150598 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133150598 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133150598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133150598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:31:51.558291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10650): Terminating (SIGTERM) 13:31:51.600226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10653): Terminating (SIGTERM) 13:31:51.642158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10656): Terminating (SIGTERM) 13:31:51.684202 --- ParallelTerminationStrategy: PID 10650 died... 13:31:51.704234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10650): Terminated: ok {rc=0} 13:31:51.750707 --- ParallelTerminationStrategy: PID 10653 died... 13:31:51.770057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10653): Terminated: ok {rc=0} 13:31:51.816081 --- ParallelTerminationStrategy: PID 10656 died... 13:31:51.835413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10656): Terminated: ok {rc=0} 13:31:51.923305 bus /sierra_3: Setting Powered False 13:31:53.022101 bus /sierra_3: Setting Powered False 13:31:54.139571 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:31:55.388833 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:31:55.395253 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:31:55.428620 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:31:55.455162 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:31:55.508181 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:31:55.541821 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:31:55.568294 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:31:56.121509 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:31:56.173905 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:31:56.185641 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:31:56.257945 tst mo_mt_call.py: using LAC 21796 13:31:56.385130 tst mo_mt_call.py: using RAC 121 13:31:56.510709 tst mo_mt_call.py: using CellId 21796 13:31:56.634897 tst mo_mt_call.py: using BVCI 21797 13:31:56.750705 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:31:56.762210 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:31:56.773466 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:31:56.785112 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:31:56.796739 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:31:56.808284 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:31:56.926227 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:31:57.042675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:57.504013 run create_hlr_db(pid=10662): Launched 13:31:57.627336 bus /sierra_2: Setting Powered False 13:31:58.687135 run create_hlr_db(pid=10662): Terminated: ok {rc=0} 13:31:59.123014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10664): Launched 13:31:59.441950 run osmo-hlr_10.42.42.2(pid=10665): Launched 13:31:59.565241 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:00.120017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10667): Launched 13:32:00.439961 run osmo-stp_10.42.42.5(pid=10668): Launched 13:32:00.562037 run osmo-msc_10.42.42.6: Starting osmo-msc 13:32:01.149775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10670): Launched 13:32:01.470630 run osmo-msc_10.42.42.6(pid=10671): Launched 13:32:01.817334 run osmo-stp_10.42.42.5(pid=10668): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10668)] 13:32:02.038592 run osmo-stp_10.42.42.5(pid=10668): stdout: | (launched: 2022-12-09_13:32:00.381394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:02.294152 run osmo-stp_10.42.42.5(pid=10668): stderr: | 20221209133200573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133200573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133200573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133200573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133200574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133200574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133200574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:02.419524 run osmo-stp_10.42.42.5(pid=10668): stdout: | (launched: 2022-12-09_13:32:00.381394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:02.543377 run osmo-stp_10.42.42.5(pid=10668): stderr: | 20221209133200573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133200573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133200573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133200573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133200574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133200574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133200574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:02.686342 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10668): Process ended prematurely: osmo-stp_10.42.42.5(pid=10668) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10668)] [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:32:02.695460 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 13:32:02.721822 run osmo-hlr_10.42.42.2(pid=10665): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10665)] 13:32:02.769565 run osmo-hlr_10.42.42.2(pid=10665): stdout: | (launched: 2022-12-09_13:31:59.383982) 13:32:02.819514 run osmo-hlr_10.42.42.2(pid=10665): stderr: | 20221209133159580 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133159580 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133159581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133159581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133159581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133159581 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133159593 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133159601 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133159601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133159601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:02.888671 run osmo-msc_10.42.42.6(pid=10671): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10671)] 13:32:02.936437 run osmo-msc_10.42.42.6(pid=10671): stdout: | (launched: 2022-12-09_13:32:01.409712) 13:32:02.985839 run osmo-msc_10.42.42.6(pid=10671): stderr: | 20221209133202011 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133202011 DLGLOBAL DEBUG validating counter group 0x7ff124602c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133202011 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133202011 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133202011 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133202011 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133202013 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133202013 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133202014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133202014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:32:03.035742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10664): Terminating (SIGTERM) 13:32:03.076014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10667): Terminating (SIGTERM) 13:32:03.116081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10670): Terminating (SIGTERM) 13:32:03.156396 --- ParallelTerminationStrategy: PID 10664 died... 13:32:03.175995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10664): Terminated: ok {rc=0} 13:32:03.220856 --- ParallelTerminationStrategy: PID 10667 died... 13:32:03.239727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10667): Terminated: ok {rc=0} 13:32:03.283881 --- ParallelTerminationStrategy: PID 10670 died... 13:32:03.302734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10670): Terminated: ok {rc=0} 13:32:03.388540 bus /sierra_3: Setting Powered False 13:32:04.488078 bus /sierra_3: Setting Powered False 13:32:05.603543 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:32:06.749495 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:32:06.761104 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:32:06.845719 tst mo_mt_call_osmux.py: using LAC 21797 13:32:06.967132 tst mo_mt_call_osmux.py: using RAC 122 13:32:07.085368 tst mo_mt_call_osmux.py: using CellId 21797 13:32:07.202957 tst mo_mt_call_osmux.py: using BVCI 21798 13:32:07.311886 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:32:07.322882 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:32:07.333638 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:32:07.344694 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:32:07.355576 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:32:07.366362 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:32:07.478360 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:32:07.595912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:08.057559 run create_hlr_db(pid=10673): Launched 13:32:08.178896 bus /sierra_2: Setting Powered False 13:32:09.238836 run create_hlr_db(pid=10673): Terminated: ok {rc=0} 13:32:09.674050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10675): Launched 13:32:09.994000 run osmo-hlr_10.42.42.2(pid=10676): Launched 13:32:10.117081 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:10.671261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10678): Launched 13:32:10.991003 run osmo-stp_10.42.42.5(pid=10679): Launched 13:32:11.113952 run osmo-msc_10.42.42.6: Starting osmo-msc 13:32:11.691438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10681): Launched 13:32:12.009624 run osmo-msc_10.42.42.6(pid=10682): Launched 13:32:12.187312 run osmo-stp_10.42.42.5(pid=10679): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10679)] 13:32:12.322490 run osmo-stp_10.42.42.5(pid=10679): stdout: | (launched: 2022-12-09_13:32:10.932595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:12.459249 run osmo-stp_10.42.42.5(pid=10679): stderr: | 20221209133211125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133211125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133211125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133211126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133211126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133211126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133211126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:12.595254 run osmo-stp_10.42.42.5(pid=10679): stdout: | (launched: 2022-12-09_13:32:10.932595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:12.722964 run osmo-stp_10.42.42.5(pid=10679): stderr: | 20221209133211125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133211125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133211125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133211126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133211126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133211126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133211126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:12.875716 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10679): Process ended prematurely: osmo-stp_10.42.42.5(pid=10679) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10679)] [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:32:12.885444 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:32:12.913688 run osmo-hlr_10.42.42.2(pid=10676): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10676)] 13:32:12.964712 run osmo-hlr_10.42.42.2(pid=10676): stdout: | (launched: 2022-12-09_13:32:09.936371) 13:32:13.017362 run osmo-hlr_10.42.42.2(pid=10676): stderr: | 20221209133210132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133210132 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133210132 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133210132 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133210132 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133210132 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133210145 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133210154 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133210154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133210154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:13.090530 run osmo-msc_10.42.42.6(pid=10682): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10682)] 13:32:13.140941 run osmo-msc_10.42.42.6(pid=10682): stdout: | (launched: 2022-12-09_13:32:11.951609) 13:32:13.193228 run osmo-msc_10.42.42.6(pid=10682): stderr: | 20221209133212271 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133212271 DLGLOBAL DEBUG validating counter group 0x7f9debb8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133212271 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133212271 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133212271 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133212272 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133212273 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133212274 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133212274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133212274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:32:13.245607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10675): Terminating (SIGTERM) 13:32:13.288152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10678): Terminating (SIGTERM) 13:32:13.330868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10681): Terminating (SIGTERM) 13:32:13.374391 --- ParallelTerminationStrategy: PID 10675 died... 13:32:13.394732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10675): Terminated: ok {rc=0} 13:32:13.442785 --- ParallelTerminationStrategy: PID 10678 died... 13:32:13.462913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10678): Terminated: ok {rc=0} 13:32:13.510353 --- ParallelTerminationStrategy: PID 10681 died... 13:32:13.530397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10681): Terminated: ok {rc=0} 13:32:13.620011 bus /sierra_3: Setting Powered False 13:32:14.719217 bus /sierra_3: Setting Powered False 13:32:15.842023 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:32:17.119049 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:32:17.126402 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:32:17.165342 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:32:17.194840 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:32:17.250702 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:32:17.286711 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:32:17.314938 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:32:17.862461 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:32:17.914552 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:32:17.926239 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:32:17.997616 tst mo_mt_call.py: using LAC 21798 13:32:18.125042 tst mo_mt_call.py: using RAC 123 13:32:18.250139 tst mo_mt_call.py: using CellId 21798 13:32:18.377048 tst mo_mt_call.py: using BVCI 21799 13:32:18.493830 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:32:18.505622 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:32:18.516882 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:32:18.528651 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:32:18.540636 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:32:18.552483 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:32:18.667520 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:32:18.784880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:19.245972 run create_hlr_db(pid=10688): Launched 13:32:19.371268 bus /sierra_2: Setting Powered False 13:32:20.431024 run create_hlr_db(pid=10688): Terminated: ok {rc=0} 13:32:20.867148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10690): Launched 13:32:21.186934 run osmo-hlr_10.42.42.2(pid=10691): Launched 13:32:21.309253 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:21.858993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10693): Launched 13:32:22.179805 run osmo-stp_10.42.42.5(pid=10694): Launched 13:32:22.301009 run osmo-msc_10.42.42.6: Starting osmo-msc 13:32:22.878583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10696): Launched 13:32:23.197989 run osmo-msc_10.42.42.6(pid=10697): Launched 13:32:23.376735 run osmo-stp_10.42.42.5(pid=10694): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10694)] 13:32:23.512397 run osmo-stp_10.42.42.5(pid=10694): stdout: | (launched: 2022-12-09_13:32:22.121449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:23.648329 run osmo-stp_10.42.42.5(pid=10694): stderr: | 20221209133222314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133222314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133222314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133222314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133222315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133222315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133222315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:23.783611 run osmo-stp_10.42.42.5(pid=10694): stdout: | (launched: 2022-12-09_13:32:22.121449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:23.911720 run osmo-stp_10.42.42.5(pid=10694): stderr: | 20221209133222314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133222314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133222314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133222314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133222315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133222315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133222315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:24.064918 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10694): Process ended prematurely: osmo-stp_10.42.42.5(pid=10694) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10694)] [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:32:24.074782 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:32:24.103315 run osmo-hlr_10.42.42.2(pid=10691): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10691)] 13:32:24.153867 run osmo-hlr_10.42.42.2(pid=10691): stdout: | (launched: 2022-12-09_13:32:21.128904) 13:32:24.206215 run osmo-hlr_10.42.42.2(pid=10691): stderr: | 20221209133221327 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133221327 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133221327 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133221327 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133221327 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133221327 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133221339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133221348 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133221348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133221348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:24.278889 run osmo-msc_10.42.42.6(pid=10697): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10697)] 13:32:24.329255 run osmo-msc_10.42.42.6(pid=10697): stdout: | (launched: 2022-12-09_13:32:23.139545) 13:32:24.381820 run osmo-msc_10.42.42.6(pid=10697): stderr: | 20221209133223460 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133223460 DLGLOBAL DEBUG validating counter group 0x7f1884694c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133223460 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133223460 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133223460 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133223460 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133223462 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133223463 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133223463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133223463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:32:24.434407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10690): Terminating (SIGTERM) 13:32:24.476374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10693): Terminating (SIGTERM) 13:32:24.518516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10696): Terminating (SIGTERM) 13:32:24.560553 --- ParallelTerminationStrategy: PID 10690 died... 13:32:24.580545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10690): Terminated: ok {rc=0} 13:32:24.627049 --- ParallelTerminationStrategy: PID 10693 died... 13:32:24.646593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10693): Terminated: ok {rc=0} 13:32:24.693178 --- ParallelTerminationStrategy: PID 10696 died... 13:32:24.712615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10696): Terminated: ok {rc=0} 13:32:24.799696 bus /sierra_3: Setting Powered False 13:32:25.898066 bus /sierra_3: Setting Powered False 13:32:27.015648 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:32:28.161691 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:32:28.173391 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:32:28.242802 tst mo_mt_call_osmux.py: using LAC 21799 13:32:28.369169 tst mo_mt_call_osmux.py: using RAC 124 13:32:28.501604 tst mo_mt_call_osmux.py: using CellId 21799 13:32:28.627359 tst mo_mt_call_osmux.py: using BVCI 21800 13:32:28.743625 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:32:28.755266 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:32:28.766673 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:32:28.778248 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:32:28.789846 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:32:28.801296 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:32:28.915933 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:32:29.033135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:29.497571 run create_hlr_db(pid=10699): Launched 13:32:29.622098 bus /sierra_2: Setting Powered False 13:32:30.682681 run create_hlr_db(pid=10699): Terminated: ok {rc=0} 13:32:31.133848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10701): Launched 13:32:31.469534 run osmo-hlr_10.42.42.2(pid=10702): Launched 13:32:31.618651 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:32.410483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10704): Launched 13:32:32.709323 run osmo-stp_10.42.42.5(pid=10705): Launched 13:32:32.823175 run osmo-msc_10.42.42.6: Starting osmo-msc 13:32:33.364524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10707): Launched 13:32:33.662646 run osmo-msc_10.42.42.6(pid=10708): Launched 13:32:33.829088 run osmo-stp_10.42.42.5(pid=10705): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10705)] 13:32:33.955470 run osmo-stp_10.42.42.5(pid=10705): stdout: | (launched: 2022-12-09_13:32:32.653617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:34.082707 run osmo-stp_10.42.42.5(pid=10705): stderr: | 20221209133232824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133232824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133232825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133232825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133232825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133232826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133232826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:34.206718 run osmo-stp_10.42.42.5(pid=10705): stdout: | (launched: 2022-12-09_13:32:32.653617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:34.325426 run osmo-stp_10.42.42.5(pid=10705): stderr: | 20221209133232824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133232824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133232825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133232825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133232825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133232826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133232826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:34.467114 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10705): Process ended prematurely: osmo-stp_10.42.42.5(pid=10705) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10705)] [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:32:34.476001 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:32:34.502305 run osmo-hlr_10.42.42.2(pid=10702): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10702)] 13:32:34.549875 run osmo-hlr_10.42.42.2(pid=10702): stdout: | (launched: 2022-12-09_13:32:31.407813) 13:32:34.599301 run osmo-hlr_10.42.42.2(pid=10702): stderr: | 20221209133231791 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133231791 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133231792 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133231792 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133231792 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133231792 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133231861 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133231873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133231873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133231873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:34.668489 run osmo-msc_10.42.42.6(pid=10708): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10708)] 13:32:34.716526 run osmo-msc_10.42.42.6(pid=10708): stdout: | (launched: 2022-12-09_13:32:33.607964) 13:32:34.766043 run osmo-msc_10.42.42.6(pid=10708): stderr: | 20221209133233881 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133233881 DLGLOBAL DEBUG validating counter group 0x7fea19659c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133233881 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133233881 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133233881 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133233881 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133233883 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133233883 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133233884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133233884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:32:34.815746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10701): Terminating (SIGTERM) 13:32:34.855416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10704): Terminating (SIGTERM) 13:32:34.894920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10707): Terminating (SIGTERM) 13:32:34.934622 --- ParallelTerminationStrategy: PID 10701 died... 13:32:34.953600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10701): Terminated: ok {rc=0} 13:32:34.997707 --- ParallelTerminationStrategy: PID 10704 died... 13:32:35.016128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10704): Terminated: ok {rc=0} 13:32:35.059543 --- ParallelTerminationStrategy: PID 10707 died... 13:32:35.078075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10707): Terminated: ok {rc=0} 13:32:35.163197 bus /sierra_3: Setting Powered False 13:32:36.263709 bus /sierra_3: Setting Powered False 13:32:37.380434 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:32:38.625249 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:32:38.631499 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:32:38.664154 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:32:38.690617 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:32:38.743964 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:32:38.777053 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:32:38.803313 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:32:39.352415 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:32:39.406206 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:32:39.418192 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:32:39.489771 tst mo_mt_call.py: using LAC 21800 13:32:39.609387 tst mo_mt_call.py: using RAC 125 13:32:39.726989 tst mo_mt_call.py: using CellId 21800 13:32:39.849307 tst mo_mt_call.py: using BVCI 21801 13:32:39.958519 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:32:39.969542 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:32:39.980272 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:32:39.991034 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:32:40.001865 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:32:40.012561 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:32:40.126805 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:32:40.240644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:40.705843 run create_hlr_db(pid=10713): Launched 13:32:40.827185 bus /sierra_2: Setting Powered False 13:32:41.887289 run create_hlr_db(pid=10713): Terminated: ok {rc=0} 13:32:42.323091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10715): Launched 13:32:42.642451 run osmo-hlr_10.42.42.2(pid=10716): Launched 13:32:42.764283 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:43.317940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10718): Launched 13:32:43.638930 run osmo-stp_10.42.42.5(pid=10719): Launched 13:32:43.760817 run osmo-msc_10.42.42.6: Starting osmo-msc 13:32:44.339424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10721): Launched 13:32:44.660556 run osmo-msc_10.42.42.6(pid=10722): Launched 13:32:44.841843 run osmo-stp_10.42.42.5(pid=10719): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10719)] 13:32:44.978006 run osmo-stp_10.42.42.5(pid=10719): stdout: | (launched: 2022-12-09_13:32:43.580890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:45.114621 run osmo-stp_10.42.42.5(pid=10719): stderr: | 20221209133243774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133243775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133243775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133243775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133243776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133243776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133243776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:45.249803 run osmo-stp_10.42.42.5(pid=10719): stdout: | (launched: 2022-12-09_13:32:43.580890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:45.378212 run osmo-stp_10.42.42.5(pid=10719): stderr: | 20221209133243774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133243775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133243775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133243775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133243776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133243776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133243776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:45.530884 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10719): Process ended prematurely: osmo-stp_10.42.42.5(pid=10719) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10719)] [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:32:45.540197 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:32:45.568723 run osmo-hlr_10.42.42.2(pid=10716): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10716)] 13:32:45.619392 run osmo-hlr_10.42.42.2(pid=10716): stdout: | (launched: 2022-12-09_13:32:42.584484) 13:32:45.671716 run osmo-hlr_10.42.42.2(pid=10716): stderr: | 20221209133242783 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133242783 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133242783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133242783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133242784 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133242784 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133242796 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133242805 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133242805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133242805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:45.744637 run osmo-msc_10.42.42.6(pid=10722): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10722)] 13:32:45.795249 run osmo-msc_10.42.42.6(pid=10722): stdout: | (launched: 2022-12-09_13:32:44.602166) 13:32:45.852605 run osmo-msc_10.42.42.6(pid=10722): stderr: | 20221209133244924 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133244924 DLGLOBAL DEBUG validating counter group 0x7f88a8de2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133244924 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133244924 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133244925 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133244925 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133244926 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133244927 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133244927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133244927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:32:45.910969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10715): Terminating (SIGTERM) 13:32:45.952606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10718): Terminating (SIGTERM) 13:32:45.996835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10721): Terminating (SIGTERM) 13:32:46.039098 --- ParallelTerminationStrategy: PID 10715 died... 13:32:46.058849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10715): Terminated: ok {rc=0} 13:32:46.106165 --- ParallelTerminationStrategy: PID 10718 died... 13:32:46.126363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10718): Terminated: ok {rc=0} 13:32:46.170990 --- ParallelTerminationStrategy: PID 10721 died... 13:32:46.190183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10721): Terminated: ok {rc=0} 13:32:46.275308 bus /sierra_3: Setting Powered False 13:32:47.373409 bus /sierra_3: Setting Powered False 13:32:48.488109 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:32:49.633682 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:32:49.645327 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:32:49.719643 tst mo_mt_call_osmux.py: using LAC 21801 13:32:49.837183 tst mo_mt_call_osmux.py: using RAC 126 13:32:49.953395 tst mo_mt_call_osmux.py: using CellId 21801 13:32:50.072687 tst mo_mt_call_osmux.py: using BVCI 21802 13:32:50.182127 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:32:50.193193 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:32:50.204057 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:32:50.214957 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:32:50.225865 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:32:50.236647 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:32:50.352146 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:32:50.471312 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:50.968033 run create_hlr_db(pid=10724): Launched 13:32:51.091022 bus /sierra_2: Setting Powered False 13:32:52.154171 run create_hlr_db(pid=10724): Terminated: ok {rc=0} 13:32:52.582535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10726): Launched 13:32:52.883643 run osmo-hlr_10.42.42.2(pid=10727): Launched 13:32:52.998026 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:53.513365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10729): Launched 13:32:53.811488 run osmo-stp_10.42.42.5(pid=10730): Launched 13:32:53.925383 run osmo-msc_10.42.42.6: Starting osmo-msc 13:32:54.467278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10732): Launched 13:32:54.765753 run osmo-msc_10.42.42.6(pid=10733): Launched 13:32:54.933211 run osmo-stp_10.42.42.5(pid=10730): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10730)] 13:32:55.059538 run osmo-stp_10.42.42.5(pid=10730): stdout: | (launched: 2022-12-09_13:32:53.756654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:55.186354 run osmo-stp_10.42.42.5(pid=10730): stderr: | 20221209133253927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133253927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133253928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133253928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133253929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133253929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133253929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:55.311335 run osmo-stp_10.42.42.5(pid=10730): stdout: | (launched: 2022-12-09_13:32:53.756654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:55.430956 run osmo-stp_10.42.42.5(pid=10730): stderr: | 20221209133253927 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133253927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133253928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133253928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133253929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133253929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133253929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:55.574609 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10730): Process ended prematurely: osmo-stp_10.42.42.5(pid=10730) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10730)] [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:32:55.583409 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:32:55.609803 run osmo-hlr_10.42.42.2(pid=10727): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10727)] 13:32:55.657243 run osmo-hlr_10.42.42.2(pid=10727): stdout: | (launched: 2022-12-09_13:32:52.828170) 13:32:55.706360 run osmo-hlr_10.42.42.2(pid=10727): stderr: | 20221209133253003 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133253003 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133253004 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133253004 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133253004 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133253004 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133253016 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133253025 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133253025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133253025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:55.775137 run osmo-msc_10.42.42.6(pid=10733): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10733)] 13:32:55.822522 run osmo-msc_10.42.42.6(pid=10733): stdout: | (launched: 2022-12-09_13:32:54.710861) 13:32:55.871530 run osmo-msc_10.42.42.6(pid=10733): stderr: | 20221209133254985 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133254985 DLGLOBAL DEBUG validating counter group 0x7f1f0fde4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133254985 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133254985 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133254985 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133254985 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133254987 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133254988 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133254988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133254988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:32:55.921149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10726): Terminating (SIGTERM) 13:32:55.960854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10729): Terminating (SIGTERM) 13:32:56.001236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10732): Terminating (SIGTERM) 13:32:56.041785 --- ParallelTerminationStrategy: PID 10726 died... 13:32:56.060841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10726): Terminated: ok {rc=0} 13:32:56.104906 --- ParallelTerminationStrategy: PID 10729 died... 13:32:56.124071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10729): Terminated: ok {rc=0} 13:32:56.167801 --- ParallelTerminationStrategy: PID 10732 died... 13:32:56.186833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10732): Terminated: ok {rc=0} 13:32:56.272472 bus /sierra_3: Setting Powered False 13:32:57.372595 bus /sierra_3: Setting Powered False 13:32:58.487331 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:32:59.746508 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:32:59.753445 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:32:59.787741 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:32:59.814707 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:32:59.868400 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:32:59.901296 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:32:59.927585 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:33:00.481943 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:33:00.533786 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:33:00.545327 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:33:00.615463 tst mo_mt_call.py: using LAC 21802 13:33:00.734688 tst mo_mt_call.py: using RAC 127 13:33:00.863079 tst mo_mt_call.py: using CellId 21802 13:33:01.006288 tst mo_mt_call.py: using BVCI 21803 13:33:01.133601 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:33:01.150203 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:33:01.167608 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:33:01.181607 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:33:01.193126 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:33:01.204733 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:33:01.320630 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:33:01.440023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:01.956610 run create_hlr_db(pid=10739): Launched 13:33:02.134410 bus /sierra_2: Setting Powered False 13:33:03.198414 run create_hlr_db(pid=10739): Terminated: ok {rc=0} 13:33:03.644387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10741): Launched 13:33:03.963976 run osmo-hlr_10.42.42.2(pid=10742): Launched 13:33:04.086364 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:04.641995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10744): Launched 13:33:04.959857 run osmo-stp_10.42.42.5(pid=10745): Launched 13:33:05.080908 run osmo-msc_10.42.42.6: Starting osmo-msc 13:33:05.658064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10747): Launched 13:33:05.978950 run osmo-msc_10.42.42.6(pid=10748): Launched 13:33:06.159343 run osmo-stp_10.42.42.5(pid=10745): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10745)] 13:33:06.304170 run osmo-stp_10.42.42.5(pid=10745): stdout: | (launched: 2022-12-09_13:33:04.901972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:06.440930 run osmo-stp_10.42.42.5(pid=10745): stderr: | 20221209133305094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133305094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133305095 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133305095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133305095 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133305095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133305096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:06.576113 run osmo-stp_10.42.42.5(pid=10745): stdout: | (launched: 2022-12-09_13:33:04.901972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:06.704245 run osmo-stp_10.42.42.5(pid=10745): stderr: | 20221209133305094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133305094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133305095 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133305095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133305095 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133305095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133305096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:06.857506 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10745): Process ended prematurely: osmo-stp_10.42.42.5(pid=10745) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10745)] [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:33:06.867075 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:33:06.895485 run osmo-hlr_10.42.42.2(pid=10742): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10742)] 13:33:06.945937 run osmo-hlr_10.42.42.2(pid=10742): stdout: | (launched: 2022-12-09_13:33:03.905696) 13:33:06.998267 run osmo-hlr_10.42.42.2(pid=10742): stderr: | 20221209133304105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133304105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133304105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133304105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133304105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133304105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133304118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133304126 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133304126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133304126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:07.071102 run osmo-msc_10.42.42.6(pid=10748): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10748)] 13:33:07.121709 run osmo-msc_10.42.42.6(pid=10748): stdout: | (launched: 2022-12-09_13:33:05.920681) 13:33:07.173684 run osmo-msc_10.42.42.6(pid=10748): stderr: | 20221209133306242 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133306242 DLGLOBAL DEBUG validating counter group 0x7fb0b5243c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133306242 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133306242 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133306242 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133306243 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133306245 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133306245 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133306245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133306245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:33:07.226184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10741): Terminating (SIGTERM) 13:33:07.268074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10744): Terminating (SIGTERM) 13:33:07.310014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10747): Terminating (SIGTERM) 13:33:07.352026 --- ParallelTerminationStrategy: PID 10741 died... 13:33:07.372092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10741): Terminated: ok {rc=0} 13:33:07.418986 --- ParallelTerminationStrategy: PID 10744 died... 13:33:07.438480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10744): Terminated: ok {rc=0} 13:33:07.485090 --- ParallelTerminationStrategy: PID 10747 died... 13:33:07.504671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10747): Terminated: ok {rc=0} 13:33:07.592624 bus /sierra_3: Setting Powered False 13:33:08.692056 bus /sierra_3: Setting Powered False 13:33:09.809098 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:33:10.958844 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:33:10.970933 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:33:11.042433 tst mo_mt_call_osmux.py: using LAC 21803 13:33:11.169168 tst mo_mt_call_osmux.py: using RAC 128 13:33:11.287901 tst mo_mt_call_osmux.py: using CellId 21803 13:33:11.409705 tst mo_mt_call_osmux.py: using BVCI 21804 13:33:11.519507 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:33:11.530864 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:33:11.542042 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:33:11.552925 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:33:11.564053 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:33:11.575092 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:33:11.691878 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:33:11.808254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:12.271887 run create_hlr_db(pid=10750): Launched 13:33:12.393686 bus /sierra_2: Setting Powered False 13:33:13.457304 run create_hlr_db(pid=10750): Terminated: ok {rc=0} 13:33:13.883363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10752): Launched 13:33:14.181873 run osmo-hlr_10.42.42.2(pid=10753): Launched 13:33:14.295202 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:14.845767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10755): Launched 13:33:15.165149 run osmo-stp_10.42.42.5(pid=10756): Launched 13:33:15.286732 run osmo-msc_10.42.42.6: Starting osmo-msc 13:33:15.870767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10758): Launched 13:33:16.213702 run osmo-msc_10.42.42.6(pid=10759): Launched 13:33:16.414412 run osmo-stp_10.42.42.5(pid=10756): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10756)] 13:33:16.647727 run osmo-stp_10.42.42.5(pid=10756): stdout: | (launched: 2022-12-09_13:33:15.106796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:16.888777 run osmo-stp_10.42.42.5(pid=10756): stderr: | 20221209133315299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133315299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133315299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133315299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133315300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133315300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133315300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:17.163438 run osmo-stp_10.42.42.5(pid=10756): stdout: | (launched: 2022-12-09_13:33:15.106796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:17.285689 run osmo-stp_10.42.42.5(pid=10756): stderr: | 20221209133315299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133315299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133315299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133315299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133315300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133315300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133315300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:17.432902 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10756): Process ended prematurely: osmo-stp_10.42.42.5(pid=10756) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10756)] [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:33:17.442506 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 13:33:17.469401 run osmo-hlr_10.42.42.2(pid=10753): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10753)] 13:33:17.518344 run osmo-hlr_10.42.42.2(pid=10753): stdout: | (launched: 2022-12-09_13:33:14.126948) 13:33:17.567942 run osmo-hlr_10.42.42.2(pid=10753): stderr: | 20221209133314302 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133314302 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133314302 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133314302 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133314302 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133314302 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133314315 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133314323 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133314323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133314323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:17.637242 run osmo-msc_10.42.42.6(pid=10759): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10759)] 13:33:17.685120 run osmo-msc_10.42.42.6(pid=10759): stdout: | (launched: 2022-12-09_13:33:16.149744) 13:33:17.734555 run osmo-msc_10.42.42.6(pid=10759): stderr: | 20221209133316830 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133316831 DLGLOBAL DEBUG validating counter group 0x7fe307e44c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133316831 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133316831 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133316831 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133316831 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133316833 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133316833 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133316834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133316834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:33:17.784789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10752): Terminating (SIGTERM) 13:33:17.824535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10755): Terminating (SIGTERM) 13:33:17.864409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10758): Terminating (SIGTERM) 13:33:17.904408 --- ParallelTerminationStrategy: PID 10752 died... 13:33:17.923708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10752): Terminated: ok {rc=0} 13:33:17.968169 --- ParallelTerminationStrategy: PID 10755 died... 13:33:17.986996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10755): Terminated: ok {rc=0} 13:33:18.031063 --- ParallelTerminationStrategy: PID 10758 died... 13:33:18.050076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10758): Terminated: ok {rc=0} 13:33:18.136010 bus /sierra_3: Setting Powered False 13:33:19.235689 bus /sierra_3: Setting Powered False 13:33:20.350930 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:33:21.608285 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:33:21.615361 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:33:21.650245 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:33:21.677852 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:33:21.730755 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:33:21.764763 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:33:21.792353 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:33:22.344013 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:33:22.393067 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:33:22.404320 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:33:22.474261 tst mo_mt_call.py: using LAC 21804 13:33:22.593250 tst mo_mt_call.py: using RAC 129 13:33:22.711074 tst mo_mt_call.py: using CellId 21804 13:33:22.837214 tst mo_mt_call.py: using BVCI 21805 13:33:22.954684 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:33:22.966384 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:33:22.977830 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:33:22.989498 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:33:23.001132 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:33:23.012726 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:33:23.130151 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:33:23.246556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:23.711675 run create_hlr_db(pid=10764): Launched 13:33:23.835166 bus /sierra_2: Setting Powered False 13:33:24.894947 run create_hlr_db(pid=10764): Terminated: ok {rc=0} 13:33:25.332529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10766): Launched 13:33:25.654587 run osmo-hlr_10.42.42.2(pid=10767): Launched 13:33:25.776765 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:26.331160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10769): Launched 13:33:26.652324 run osmo-stp_10.42.42.5(pid=10770): Launched 13:33:26.777437 run osmo-msc_10.42.42.6: Starting osmo-msc 13:33:27.356636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10772): Launched 13:33:27.678313 run osmo-msc_10.42.42.6(pid=10773): Launched 13:33:27.859069 run osmo-stp_10.42.42.5(pid=10770): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10770)] 13:33:27.995823 run osmo-stp_10.42.42.5(pid=10770): stdout: | (launched: 2022-12-09_13:33:26.594116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:28.132799 run osmo-stp_10.42.42.5(pid=10770): stderr: | 20221209133326786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133326786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133326786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133326787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133326787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133326787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133326787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:28.268375 run osmo-stp_10.42.42.5(pid=10770): stdout: | (launched: 2022-12-09_13:33:26.594116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:28.397064 run osmo-stp_10.42.42.5(pid=10770): stderr: | 20221209133326786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133326786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133326786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133326787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133326787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133326787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133326787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:28.550975 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10770): Process ended prematurely: osmo-stp_10.42.42.5(pid=10770) [trial-2360↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10770)] [trial-2360↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:33:28.560522 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:33:28.588810 run osmo-hlr_10.42.42.2(pid=10767): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10767)] 13:33:28.640246 run osmo-hlr_10.42.42.2(pid=10767): stdout: | (launched: 2022-12-09_13:33:25.595988) 13:33:28.692769 run osmo-hlr_10.42.42.2(pid=10767): stderr: | 20221209133325793 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133325793 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133325793 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133325794 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133325794 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133325794 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133325806 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133325816 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133325816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133325816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:28.766446 run osmo-msc_10.42.42.6(pid=10773): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10773)] 13:33:28.817049 run osmo-msc_10.42.42.6(pid=10773): stdout: | (launched: 2022-12-09_13:33:27.619876) 13:33:28.869229 run osmo-msc_10.42.42.6(pid=10773): stderr: | 20221209133327943 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133327943 DLGLOBAL DEBUG validating counter group 0x7f56f44fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133327943 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133327943 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133327943 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133327944 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133327945 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133327946 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133327946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133327946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:33:28.922012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10766): Terminating (SIGTERM) 13:33:28.964366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10769): Terminating (SIGTERM) 13:33:29.007042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10772): Terminating (SIGTERM) 13:33:29.049833 --- ParallelTerminationStrategy: PID 10766 died... 13:33:29.070111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10766): Terminated: ok {rc=0} 13:33:29.117351 --- ParallelTerminationStrategy: PID 10769 died... 13:33:29.137135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10769): Terminated: ok {rc=0} 13:33:29.184252 --- ParallelTerminationStrategy: PID 10772 died... 13:33:29.203928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10772): Terminated: ok {rc=0} 13:33:29.291763 bus /sierra_3: Setting Powered False 13:33:30.388931 bus /sierra_3: Setting Powered False 13:33:31.505057 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:33:32.669091 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:33:32.681456 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:33:32.753195 tst mo_mt_call_osmux.py: using LAC 21805 13:33:32.871822 tst mo_mt_call_osmux.py: using RAC 130 13:33:32.987992 tst mo_mt_call_osmux.py: using CellId 21805 13:33:33.103922 tst mo_mt_call_osmux.py: using BVCI 21806 13:33:33.212341 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:33:33.223506 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:33:33.234741 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:33:33.245929 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:33:33.257149 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:33:33.268127 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:33:33.384702 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:33:33.501510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:33.966225 run create_hlr_db(pid=10775): Launched 13:33:34.089534 bus /sierra_2: Setting Powered False 13:33:35.149269 run create_hlr_db(pid=10775): Terminated: ok {rc=0} 13:33:35.567664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10777): Launched 13:33:35.866004 run osmo-hlr_10.42.42.2(pid=10778): Launched 13:33:35.979191 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:36.493807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10780): Launched 13:33:36.792605 run osmo-stp_10.42.42.5(pid=10781): Launched 13:33:36.905795 run osmo-msc_10.42.42.6: Starting osmo-msc 13:33:37.454556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10783): Launched 13:33:37.755023 run osmo-msc_10.42.42.6(pid=10784): Launched 13:33:37.922511 run osmo-stp_10.42.42.5(pid=10781): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10781)] 13:33:38.049405 run osmo-stp_10.42.42.5(pid=10781): stdout: | (launched: 2022-12-09_13:33:36.737948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:38.176032 run osmo-stp_10.42.42.5(pid=10781): stderr: | 20221209133336909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133336909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133336910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133336910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133336910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133336911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133336911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:38.300712 run osmo-stp_10.42.42.5(pid=10781): stdout: | (launched: 2022-12-09_13:33:36.737948) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:38.419949 run osmo-stp_10.42.42.5(pid=10781): stderr: | 20221209133336909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133336909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133336910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133336910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133336910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133336911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133336911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:38.563545 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10781): Process ended prematurely: osmo-stp_10.42.42.5(pid=10781) [trial-2360↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10781)] [trial-2360↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:33:38.572662 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 13:33:38.599156 run osmo-hlr_10.42.42.2(pid=10778): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10778)] 13:33:38.646603 run osmo-hlr_10.42.42.2(pid=10778): stdout: | (launched: 2022-12-09_13:33:35.811105) 13:33:38.695756 run osmo-hlr_10.42.42.2(pid=10778): stderr: | 20221209133335987 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133335987 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133335987 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133335987 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133335987 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133335987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133335999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133336008 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133336009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133336009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:38.764646 run osmo-msc_10.42.42.6(pid=10784): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10784)] 13:33:38.811773 run osmo-msc_10.42.42.6(pid=10784): stdout: | (launched: 2022-12-09_13:33:37.699299) 13:33:38.860594 run osmo-msc_10.42.42.6(pid=10784): stderr: | 20221209133337970 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133337970 DLGLOBAL DEBUG validating counter group 0x7fb162013c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133337970 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133337970 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133337970 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133337971 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133337972 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133337973 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133337973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133337973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:33:38.909780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10777): Terminating (SIGTERM) 13:33:38.949151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10780): Terminating (SIGTERM) 13:33:38.988616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10783): Terminating (SIGTERM) 13:33:39.028319 --- ParallelTerminationStrategy: PID 10777 died... 13:33:39.047195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10777): Terminated: ok {rc=0} 13:33:39.090975 --- ParallelTerminationStrategy: PID 10780 died... 13:33:39.109626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10780): Terminated: ok {rc=0} 13:33:39.153149 --- ParallelTerminationStrategy: PID 10783 died... 13:33:39.171565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10783): Terminated: ok {rc=0} 13:33:39.256696 bus /sierra_3: Setting Powered False 13:33:40.358726 bus /sierra_3: Setting Powered False 13:33:41.473577 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:33:42.727424 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:33:42.733106 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:33:42.765722 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:33:42.792208 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:33:42.842503 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:33:42.874817 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:33:42.900996 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:33:43.451261 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:33:43.498915 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:33:43.509871 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:33:43.577648 tst mo_mt_call.py: using LAC 21806 13:33:43.693470 tst mo_mt_call.py: using RAC 131 13:33:43.811366 tst mo_mt_call.py: using CellId 21806 13:33:43.942053 tst mo_mt_call.py: using BVCI 21807 13:33:44.051877 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:33:44.062659 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:33:44.073336 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:33:44.083814 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:33:44.094355 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:33:44.104924 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:33:44.221268 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:33:44.337671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:44.835155 run create_hlr_db(pid=10789): Launched 13:33:44.957346 bus /sierra_2: Setting Powered False 13:33:46.036533 run create_hlr_db(pid=10789): Terminated: ok {rc=0} 13:33:46.488558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10791): Launched 13:33:46.810794 run osmo-hlr_10.42.42.2(pid=10792): Launched 13:33:47.065928 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:47.625354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10794): Launched 13:33:47.925162 run osmo-stp_10.42.42.5(pid=10795): Launched 13:33:48.039126 run osmo-msc_10.42.42.6: Starting osmo-msc 13:33:48.582254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10797): Launched 13:33:48.883201 run osmo-msc_10.42.42.6(pid=10798): Launched 13:33:49.049667 run osmo-stp_10.42.42.5(pid=10795): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10795)] 13:33:49.176105 run osmo-stp_10.42.42.5(pid=10795): stdout: | (launched: 2022-12-09_13:33:47.870309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:49.301918 run osmo-stp_10.42.42.5(pid=10795): stderr: | 20221209133348041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133348042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133348042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133348042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133348043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133348043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133348043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:49.426224 run osmo-stp_10.42.42.5(pid=10795): stdout: | (launched: 2022-12-09_13:33:47.870309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:49.545131 run osmo-stp_10.42.42.5(pid=10795): stderr: | 20221209133348041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133348042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133348042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133348042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133348043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133348043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133348043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:49.687258 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10795): Process ended prematurely: osmo-stp_10.42.42.5(pid=10795) [trial-2360↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10795)] [trial-2360↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:33:49.696084 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:33:49.722185 run osmo-hlr_10.42.42.2(pid=10792): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10792)] 13:33:49.769649 run osmo-hlr_10.42.42.2(pid=10792): stdout: | (launched: 2022-12-09_13:33:46.755320) 13:33:49.818830 run osmo-hlr_10.42.42.2(pid=10792): stderr: | 20221209133346983 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133346983 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133346983 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133346983 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133346983 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133346983 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133346995 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133347007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133347008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133347008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:49.887341 run osmo-msc_10.42.42.6(pid=10798): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10798)] 13:33:49.935354 run osmo-msc_10.42.42.6(pid=10798): stdout: | (launched: 2022-12-09_13:33:48.828266) 13:33:49.984861 run osmo-msc_10.42.42.6(pid=10798): stderr: | 20221209133349102 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133349102 DLGLOBAL DEBUG validating counter group 0x7f305b7c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133349102 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133349103 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133349104 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133349104 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133349106 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133349106 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133349106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133349106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:33:50.034179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10791): Terminating (SIGTERM) 13:33:50.073530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10794): Terminating (SIGTERM) 13:33:50.113029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10797): Terminating (SIGTERM) 13:33:50.152294 --- ParallelTerminationStrategy: PID 10791 died... 13:33:50.171230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10791): Terminated: ok {rc=0} 13:33:50.214610 --- ParallelTerminationStrategy: PID 10794 died... 13:33:50.232898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10794): Terminated: ok {rc=0} 13:33:50.276217 --- ParallelTerminationStrategy: PID 10797 died... 13:33:50.294720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10797): Terminated: ok {rc=0} 13:33:50.379003 bus /sierra_3: Setting Powered False 13:33:51.481223 bus /sierra_3: Setting Powered False 13:33:52.599825 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:33:53.744146 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:33:53.755603 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:33:53.826094 tst mo_mt_call_osmux.py: using LAC 21807 13:33:53.945474 tst mo_mt_call_osmux.py: using RAC 132 13:33:54.062420 tst mo_mt_call_osmux.py: using CellId 21807 13:33:54.181654 tst mo_mt_call_osmux.py: using BVCI 21808 13:33:54.291110 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:33:54.302099 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:33:54.312706 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:33:54.323334 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:33:54.333969 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:33:54.344571 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:33:54.463136 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:33:54.577246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:55.044456 run create_hlr_db(pid=10800): Launched 13:33:55.166443 bus /sierra_2: Setting Powered False 13:33:56.226287 run create_hlr_db(pid=10800): Terminated: ok {rc=0} 13:33:56.662881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10802): Launched 13:33:56.984423 run osmo-hlr_10.42.42.2(pid=10803): Launched 13:33:57.106165 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:57.658607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10805): Launched 13:33:57.978919 run osmo-stp_10.42.42.5(pid=10806): Launched 13:33:58.100475 run osmo-msc_10.42.42.6: Starting osmo-msc 13:33:58.677982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10808): Launched 13:33:58.999544 run osmo-msc_10.42.42.6(pid=10809): Launched 13:33:59.178123 run osmo-stp_10.42.42.5(pid=10806): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10806)] 13:33:59.313265 run osmo-stp_10.42.42.5(pid=10806): stdout: | (launched: 2022-12-09_13:33:57.920901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:59.449592 run osmo-stp_10.42.42.5(pid=10806): stderr: | 20221209133358113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133358113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133358114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133358114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133358114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133358115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133358115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:59.584196 run osmo-stp_10.42.42.5(pid=10806): stdout: | (launched: 2022-12-09_13:33:57.920901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:59.711706 run osmo-stp_10.42.42.5(pid=10806): stderr: | 20221209133358113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133358113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133358114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133358114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133358114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133358115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133358115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:59.864283 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10806): Process ended prematurely: osmo-stp_10.42.42.5(pid=10806) [trial-2360↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10806)] [trial-2360↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:33:59.873926 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:33:59.902202 run osmo-hlr_10.42.42.2(pid=10803): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10803)] 13:33:59.952546 run osmo-hlr_10.42.42.2(pid=10803): stdout: | (launched: 2022-12-09_13:33:56.926035) 13:34:00.004670 run osmo-hlr_10.42.42.2(pid=10803): stderr: | 20221209133357124 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133357124 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133357124 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133357124 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133357124 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133357124 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133357136 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133357144 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133357144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133357144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:00.077648 run osmo-msc_10.42.42.6(pid=10809): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10809)] 13:34:00.128180 run osmo-msc_10.42.42.6(pid=10809): stdout: | (launched: 2022-12-09_13:33:58.941226) 13:34:00.180065 run osmo-msc_10.42.42.6(pid=10809): stderr: | 20221209133359264 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133359264 DLGLOBAL DEBUG validating counter group 0x7f38a286dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133359265 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133359265 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133359265 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133359265 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133359267 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133359267 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133359267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133359267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:34:00.232335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10802): Terminating (SIGTERM) 13:34:00.274433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10805): Terminating (SIGTERM) 13:34:00.316422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10808): Terminating (SIGTERM) 13:34:00.358604 --- ParallelTerminationStrategy: PID 10802 died... 13:34:00.378616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10802): Terminated: ok {rc=0} 13:34:00.425417 --- ParallelTerminationStrategy: PID 10805 died... 13:34:00.445095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10805): Terminated: ok {rc=0} 13:34:00.491309 --- ParallelTerminationStrategy: PID 10808 died... 13:34:00.510842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10808): Terminated: ok {rc=0} 13:34:00.598972 bus /sierra_3: Setting Powered False 13:34:01.706661 bus /sierra_3: Setting Powered False 13:34:02.841060 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 emergency:trx-lms --------------------------------------------------------------------- 13:34:04.088378 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:34:04.092523 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 13:34:04.125603 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 13:34:04.152179 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 13:34:04.239559 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 13:34:04.274917 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 13:34:04.302627 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 13:34:04.882753 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2360 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 13:34:04.888242 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:34:04.899513 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 13:34:04.949767 tst emergency_mo_mt_call.py: using LAC 21808 13:34:05.074596 tst emergency_mo_mt_call.py: using RAC 133 13:34:05.197703 tst emergency_mo_mt_call.py: using CellId 21808 13:34:05.314760 tst emergency_mo_mt_call.py: using BVCI 21809 13:34:05.423608 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:34:05.434424 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:34:05.445027 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:34:05.456119 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:34:05.467307 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:34:05.478183 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:34:05.596076 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:34:05.718805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:06.205586 run create_hlr_db(pid=10814): Launched 13:34:06.326796 bus /sierra_2: Setting Powered False 13:34:07.389509 run create_hlr_db(pid=10814): Terminated: ok {rc=0} 13:34:07.827943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10816): Launched 13:34:08.140783 run osmo-hlr_10.42.42.2(pid=10817): Launched 13:34:08.262482 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:08.808353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10819): Launched 13:34:09.123307 run osmo-stp_10.42.42.5(pid=10820): Launched 13:34:09.253039 tst emergency_mo_mt_call.py: using MSISDN 7232 13:34:09.413444 run osmo-msc_10.42.42.6: Starting osmo-msc 13:34:09.978311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10822): Launched 13:34:10.294350 run osmo-msc_10.42.42.6(pid=10823): Launched 13:34:10.470642 run osmo-stp_10.42.42.5(pid=10820): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10820)] 13:34:10.604341 run osmo-stp_10.42.42.5(pid=10820): stdout: | (launched: 2022-12-09_13:34:09.065883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:10.738538 run osmo-stp_10.42.42.5(pid=10820): stderr: | 20221209133409258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133409258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133409258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133409259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133409259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133409260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133409260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:10.872257 run osmo-stp_10.42.42.5(pid=10820): stdout: | (launched: 2022-12-09_13:34:09.065883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:10.997708 run osmo-stp_10.42.42.5(pid=10820): stderr: | 20221209133409258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133409258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133409258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133409259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133409259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133409260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133409260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:11.147900 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10820): Process ended prematurely: osmo-stp_10.42.42.5(pid=10820) [trial-2360↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10820)] [trial-2360↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 13:34:11.156832 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 13:34:11.185147 run osmo-hlr_10.42.42.2(pid=10817): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10817)] 13:34:11.235809 run osmo-hlr_10.42.42.2(pid=10817): stdout: | (launched: 2022-12-09_13:34:08.083320) 13:34:11.288032 run osmo-hlr_10.42.42.2(pid=10817): stderr: | 20221209133408280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133408280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133408280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133408280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133408280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133408280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133408293 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133408301 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133408301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133408301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:11.360923 run osmo-msc_10.42.42.6(pid=10823): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10823)] 13:34:11.411429 run osmo-msc_10.42.42.6(pid=10823): stdout: | (launched: 2022-12-09_13:34:10.236476) 13:34:11.463667 run osmo-msc_10.42.42.6(pid=10823): stderr: | 20221209133410558 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133410558 DLGLOBAL DEBUG validating counter group 0x7f252a385c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133410558 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133410558 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133410558 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133410559 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133410560 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133410561 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133410561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133410561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:34:11.515919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10816): Terminating (SIGTERM) 13:34:11.558189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10819): Terminating (SIGTERM) 13:34:11.600398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10822): Terminating (SIGTERM) 13:34:11.642860 --- ParallelTerminationStrategy: PID 10816 died... 13:34:11.662816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10816): Terminated: ok {rc=0} 13:34:11.709561 --- ParallelTerminationStrategy: PID 10819 died... 13:34:11.728918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10819): Terminated: ok {rc=0} 13:34:11.775479 --- ParallelTerminationStrategy: PID 10822 died... 13:34:11.794892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10822): Terminated: ok {rc=0} 13:34:11.894681 bus /sierra_3: Setting Powered False 13:34:13.007370 bus /sierra_3: Setting Powered False 13:34:14.123049 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 13:34:15.208017 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:34:15.219764 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 13:34:15.271946 tst emergency_preemptive_call.py: using LAC 21809 13:34:15.397504 tst emergency_preemptive_call.py: using RAC 134 13:34:15.516469 tst emergency_preemptive_call.py: using CellId 21809 13:34:15.632819 tst emergency_preemptive_call.py: using BVCI 21810 13:34:15.739999 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:34:15.750809 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:34:15.761396 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:34:15.772309 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:34:15.783341 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:34:15.794233 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:34:15.944732 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:34:16.096559 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:34:16.233335 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:34:16.346661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:16.818833 run create_hlr_db(pid=10825): Launched 13:34:16.975042 bus /sierra_2: Setting Powered False 13:34:18.034275 run create_hlr_db(pid=10825): Terminated: ok {rc=0} 13:34:18.445668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10827): Launched 13:34:18.739989 run osmo-hlr_10.42.42.2(pid=10828): Launched 13:34:18.852082 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:19.356094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10830): Launched 13:34:19.649167 run osmo-stp_10.42.42.5(pid=10831): Launched 13:34:19.771326 tst emergency_preemptive_call.py: using MSISDN 7233 13:34:19.919917 run osmo-msc_10.42.42.6: Starting osmo-msc 13:34:20.445972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10833): Launched 13:34:20.740163 run osmo-msc_10.42.42.6(pid=10834): Launched 13:34:20.904874 run osmo-stp_10.42.42.5(pid=10831): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10831)] 13:34:21.028420 run osmo-stp_10.42.42.5(pid=10831): stdout: | (launched: 2022-12-09_13:34:19.595247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:21.153493 run osmo-stp_10.42.42.5(pid=10831): stderr: | 20221209133419765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133419766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133419766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133419766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133419767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133419767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133419767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:21.276471 run osmo-stp_10.42.42.5(pid=10831): stdout: | (launched: 2022-12-09_13:34:19.595247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:21.393520 run osmo-stp_10.42.42.5(pid=10831): stderr: | 20221209133419765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133419766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133419766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133419766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133419767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133419767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133419767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:21.533123 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10831): Process ended prematurely: osmo-stp_10.42.42.5(pid=10831) [trial-2360↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10831)] [trial-2360↪emergency:trx-lms↪emergency_preemptive_call.py:32] 13:34:21.541606 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 13:34:21.567815 run osmo-hlr_10.42.42.2(pid=10828): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10828)] 13:34:21.615789 run osmo-hlr_10.42.42.2(pid=10828): stdout: | (launched: 2022-12-09_13:34:18.685640) 13:34:21.665502 run osmo-hlr_10.42.42.2(pid=10828): stderr: | 20221209133418860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133418860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133418860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133418860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133418861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133418861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133418871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133418880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133418880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133418881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:21.734911 run osmo-msc_10.42.42.6(pid=10834): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10834)] 13:34:21.782651 run osmo-msc_10.42.42.6(pid=10834): stdout: | (launched: 2022-12-09_13:34:20.686175) 13:34:21.832109 run osmo-msc_10.42.42.6(pid=10834): stderr: | 20221209133420960 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133420960 DLGLOBAL DEBUG validating counter group 0x7f6f8fd00c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133420960 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133420960 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133420961 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133420961 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133420963 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133420963 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133420963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133420963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:34:21.881904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10827): Terminating (SIGTERM) 13:34:21.921802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10830): Terminating (SIGTERM) 13:34:21.961826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10833): Terminating (SIGTERM) 13:34:22.001854 --- ParallelTerminationStrategy: PID 10827 died... 13:34:22.021128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10827): Terminated: ok {rc=0} 13:34:22.065192 --- ParallelTerminationStrategy: PID 10830 died... 13:34:22.084046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10830): Terminated: ok {rc=0} 13:34:22.128651 --- ParallelTerminationStrategy: PID 10833 died... 13:34:22.147575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10833): Terminated: ok {rc=0} 13:34:22.231226 bus /sierra_9: Setting Powered False 13:34:23.327425 bus /sierra_9: Setting Powered False 13:34:24.444233 bus /sierra_8: Setting Powered False 13:34:25.542805 bus /sierra_8: Setting Powered False 13:34:26.656839 bus /sierra_3: Setting Powered False 13:34:27.753868 bus /sierra_3: Setting Powered False 13:34:28.868937 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-lms --------------------------------------------------------------------- 13:34:30.148402 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:34:30.152641 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 13:34:30.185272 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 13:34:30.223382 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 13:34:30.308310 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 13:34:30.341532 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 13:34:30.380032 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 13:34:30.993517 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 13:34:31.053281 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:31.066232 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:34:31.119138 tst cs_paging_gprs_active.py: using LAC 21810 13:34:31.247521 tst cs_paging_gprs_active.py: using RAC 135 13:34:31.415415 tst cs_paging_gprs_active.py: using CellId 21810 13:34:31.581438 tst cs_paging_gprs_active.py: using BVCI 21811 13:34:31.696882 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:31.708398 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:31.719651 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:31.731674 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:31.744020 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:31.756175 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:31.768262 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:31.780071 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:31.792183 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:34:31.911256 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:34:32.029224 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:34:32.253490 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:32.576771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10839): Launched 13:34:32.858433 run iperf3-srv_10.42.42.10(pid=10840): Launched 13:34:32.978987 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:34:33.195856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:33.517972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10841): Launched 13:34:33.798572 run iperf3-srv_10.42.42.10(pid=10842): Launched 13:34:33.918915 tst cs_paging_gprs_active.py:38: start network... 13:34:34.134978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:34.632597 run create_hlr_db(pid=10843): Launched 13:34:34.755630 bus /sierra_2: Setting Powered False 13:34:35.818986 run create_hlr_db(pid=10843): Terminated: ok {rc=0} 13:34:36.264028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10845): Launched 13:34:36.585063 run osmo-hlr_10.42.42.2(pid=10846): Launched 13:34:36.707010 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:37.261115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10848): Launched 13:34:37.582561 run osmo-stp_10.42.42.5(pid=10849): Launched 13:34:37.705543 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:34:38.258080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10851): Launched 13:34:38.382161 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:34:38.653093 run patchelf(pid=10852): Launched 13:34:38.832276 run osmo-stp_10.42.42.5(pid=10849): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10849)] 13:34:38.967785 run osmo-stp_10.42.42.5(pid=10849): stdout: | (launched: 2022-12-09_13:34:37.524137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:39.105812 run osmo-stp_10.42.42.5(pid=10849): stderr: | 20221209133437715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133437715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133437715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133437716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133437716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133437716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133437717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:39.243005 run osmo-stp_10.42.42.5(pid=10849): stdout: | (launched: 2022-12-09_13:34:37.524137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:39.374732 run osmo-stp_10.42.42.5(pid=10849): stderr: | 20221209133437715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133437715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133437715 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133437716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133437716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133437716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133437717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:39.530873 run patchelf(pid=10852): Terminating (SIGINT) 13:34:39.709393 run patchelf(pid=10852): Terminated: ok {rc=0} 13:34:39.838023 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10849): Process ended prematurely: osmo-stp_10.42.42.5(pid=10849) [trial-2360↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10849)] [trial-2360↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 13:34:39.848131 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:34:39.877278 run osmo-hlr_10.42.42.2(pid=10846): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10846)] 13:34:39.927452 run osmo-hlr_10.42.42.2(pid=10846): stdout: | (launched: 2022-12-09_13:34:36.526031) 13:34:39.979534 run osmo-hlr_10.42.42.2(pid=10846): stderr: | 20221209133436725 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133436725 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133436725 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133436726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133436726 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133436726 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133436737 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133436745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133436746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133436746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:40.032073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10839): Terminating (SIGTERM) 13:34:40.074237 run iperf3-srv_10.42.42.10(pid=10840): Terminating (SIGTERM) 13:34:40.116047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10841): Terminating (SIGTERM) 13:34:40.158035 run iperf3-srv_10.42.42.10(pid=10842): Terminating (SIGTERM) 13:34:40.199816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10845): Terminating (SIGTERM) 13:34:40.241600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10848): Terminating (SIGTERM) 13:34:40.283283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10851): Terminating (SIGTERM) 13:34:40.325248 --- ParallelTerminationStrategy: PID 10839 died... 13:34:40.345271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10839): Terminated: ok {rc=0} 13:34:40.391991 --- ParallelTerminationStrategy: PID 10840 died... 13:34:40.411635 run iperf3-srv_10.42.42.10(pid=10840): Terminated {rc=256} 13:34:40.458516 --- ParallelTerminationStrategy: PID 10841 died... 13:34:40.478206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10841): Terminated: ok {rc=0} 13:34:40.524819 --- ParallelTerminationStrategy: PID 10842 died... 13:34:40.544808 run iperf3-srv_10.42.42.10(pid=10842): Terminated {rc=256} 13:34:40.591452 --- ParallelTerminationStrategy: PID 10845 died... 13:34:40.611193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10845): Terminated: ok {rc=0} 13:34:40.657942 --- ParallelTerminationStrategy: PID 10848 died... 13:34:40.677714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10848): Terminated: ok {rc=0} 13:34:40.724381 --- ParallelTerminationStrategy: PID 10851 died... 13:34:40.744136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10851): Terminated: ok {rc=0} 13:34:40.832750 bus /gobi_0: Setting Powered False 13:34:41.931824 bus /gobi_0: Setting Powered False 13:34:43.048276 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms iperf3.py ---------------------------------------------- 13:34:44.196869 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:44.208679 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:34:44.262737 tst iperf3.py: using LAC 21811 13:34:44.389782 tst iperf3.py: using RAC 136 13:34:44.515821 tst iperf3.py: using CellId 21811 13:34:44.639369 tst iperf3.py: using BVCI 21812 13:34:44.750673 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:44.761436 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:44.771871 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:44.782387 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:44.792725 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:44.803143 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:44.813837 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:44.824264 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:44.834823 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:34:44.950061 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:34:45.167286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:45.489782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10853): Launched 13:34:45.769306 run iperf3-srv_10.42.42.10(pid=10854): Launched 13:34:45.898433 tst iperf3.py:8: start network... 13:34:46.124742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:46.609429 run create_hlr_db(pid=10855): Launched 13:34:46.779565 bus /gobi_6: Setting Powered False 13:34:47.839194 run create_hlr_db(pid=10855): Terminated: ok {rc=0} 13:34:48.302990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10857): Launched 13:34:48.627659 run osmo-hlr_10.42.42.2(pid=10858): Launched 13:34:48.752282 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:49.308793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10860): Launched 13:34:49.629181 run osmo-stp_10.42.42.5(pid=10861): Launched 13:34:49.752729 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:34:50.304300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10863): Launched 13:34:50.427451 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:34:50.698342 run patchelf(pid=10864): Launched 13:34:50.877050 run osmo-stp_10.42.42.5(pid=10861): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10861)] 13:34:51.013113 run osmo-stp_10.42.42.5(pid=10861): stdout: | (launched: 2022-12-09_13:34:49.570679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:51.150779 run osmo-stp_10.42.42.5(pid=10861): stderr: | 20221209133449763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133449763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133449763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133449764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133449764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133449764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133449764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:51.288238 run osmo-stp_10.42.42.5(pid=10861): stdout: | (launched: 2022-12-09_13:34:49.570679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:51.419971 run osmo-stp_10.42.42.5(pid=10861): stderr: | 20221209133449763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133449763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133449763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133449764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133449764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133449764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133449764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:51.576753 run patchelf(pid=10864): Terminating (SIGINT) 13:34:51.755736 run patchelf(pid=10864): Terminated: ok {rc=0} 13:34:51.884465 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10861): Process ended prematurely: osmo-stp_10.42.42.5(pid=10861) [trial-2360↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10861)] [trial-2360↪gprs:trx-lms↪iperf3.py:8] 13:34:51.894567 tst iperf3.py:8: Test FAILED (7.7 sec) 13:34:51.923683 run osmo-hlr_10.42.42.2(pid=10858): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10858)] 13:34:51.973795 run osmo-hlr_10.42.42.2(pid=10858): stdout: | (launched: 2022-12-09_13:34:48.567710) 13:34:52.025842 run osmo-hlr_10.42.42.2(pid=10858): stderr: | 20221209133448769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133448769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133448769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133448769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133448769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133448769 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133448784 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133448794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133448794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133448794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:52.078242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10853): Terminating (SIGTERM) 13:34:52.120271 run iperf3-srv_10.42.42.10(pid=10854): Terminating (SIGTERM) 13:34:52.162269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10857): Terminating (SIGTERM) 13:34:52.204307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10860): Terminating (SIGTERM) 13:34:52.246130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10863): Terminating (SIGTERM) 13:34:52.288146 --- ParallelTerminationStrategy: PID 10853 died... 13:34:52.308240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10853): Terminated: ok {rc=0} 13:34:52.354540 --- ParallelTerminationStrategy: PID 10854 died... 13:34:52.373840 run iperf3-srv_10.42.42.10(pid=10854): Terminated {rc=256} 13:34:52.419757 --- ParallelTerminationStrategy: PID 10857 died... 13:34:52.439607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10857): Terminated: ok {rc=0} 13:34:52.486072 --- ParallelTerminationStrategy: PID 10860 died... 13:34:52.505656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10860): Terminated: ok {rc=0} 13:34:52.552033 --- ParallelTerminationStrategy: PID 10863 died... 13:34:52.571661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10863): Terminated: ok {rc=0} 13:34:52.659155 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms iperf3m4.py ---------------------------------------------- 13:34:53.803745 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:53.814891 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:34:53.864465 tst iperf3m4.py: using LAC 21812 13:34:53.984777 tst iperf3m4.py: using RAC 137 13:34:54.114824 tst iperf3m4.py: using CellId 21812 13:34:54.240869 tst iperf3m4.py: using BVCI 21813 13:34:54.357429 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:54.368448 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:54.379366 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:54.390810 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:54.401917 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:54.412860 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:54.424167 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:54.435527 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:34:54.446861 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:34:54.568165 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:34:54.690211 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:34:54.807108 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:34:54.928053 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:34:55.144768 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:55.467321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10865): Launched 13:34:55.746382 run iperf3-srv_10.42.42.10(pid=10866): Launched 13:34:55.858609 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:34:56.057993 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:56.358230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10867): Launched 13:34:56.618907 run iperf3-srv_10.42.42.10(pid=10868): Launched 13:34:56.730676 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:34:56.929339 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:57.229120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10869): Launched 13:34:57.489713 run iperf3-srv_10.42.42.10(pid=10870): Launched 13:34:57.601327 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:34:57.800285 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:58.100033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10871): Launched 13:34:58.360354 run iperf3-srv_10.42.42.10(pid=10872): Launched 13:34:58.471870 tst iperf3m4.py:8: start network... 13:34:58.670495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:59.134671 run create_hlr_db(pid=10873): Launched 13:34:59.257908 bus /gobi_6: Setting Powered False 13:35:00.317581 run create_hlr_db(pid=10873): Terminated: ok {rc=0} 13:35:00.732702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10875): Launched 13:35:01.042547 run osmo-hlr_10.42.42.2(pid=10876): Launched 13:35:01.326400 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:01.899290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10881): Launched 13:35:02.242430 run osmo-stp_10.42.42.5(pid=10882): Launched 13:35:02.383397 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:35:02.939310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10884): Launched 13:35:03.063674 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:35:03.334783 run patchelf(pid=10885): Launched 13:35:03.514179 run osmo-stp_10.42.42.5(pid=10882): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10882)] 13:35:03.650478 run osmo-stp_10.42.42.5(pid=10882): stdout: | (launched: 2022-12-09_13:35:02.183447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:03.787811 run osmo-stp_10.42.42.5(pid=10882): stderr: | 20221209133502389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133502389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133502389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133502390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133502390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133502390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133502390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:03.925378 run osmo-stp_10.42.42.5(pid=10882): stdout: | (launched: 2022-12-09_13:35:02.183447) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:04.057454 run osmo-stp_10.42.42.5(pid=10882): stderr: | 20221209133502389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133502389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133502389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133502390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133502390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133502390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133502390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:04.214234 run patchelf(pid=10885): Terminating (SIGINT) 13:35:04.393574 run patchelf(pid=10885): Terminated: ok {rc=0} 13:35:04.522972 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10882): Process ended prematurely: osmo-stp_10.42.42.5(pid=10882) [trial-2360↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10882)] [trial-2360↪gprs:trx-lms↪iperf3m4.py:8] 13:35:04.533190 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:35:04.562912 run osmo-hlr_10.42.42.2(pid=10876): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10876)] 13:35:04.613556 run osmo-hlr_10.42.42.2(pid=10876): stdout: | (launched: 2022-12-09_13:35:00.984207) 13:35:04.665792 run osmo-hlr_10.42.42.2(pid=10876): stderr: | 20221209133501210 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133501210 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133501210 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133501211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133501211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133501211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133501226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133501235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133501235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133501235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:04.718524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10865): Terminating (SIGTERM) 13:35:04.760812 run iperf3-srv_10.42.42.10(pid=10866): Terminating (SIGTERM) 13:35:04.803358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10867): Terminating (SIGTERM) 13:35:04.845872 run iperf3-srv_10.42.42.10(pid=10868): Terminating (SIGTERM) 13:35:04.888217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10869): Terminating (SIGTERM) 13:35:04.930742 run iperf3-srv_10.42.42.10(pid=10870): Terminating (SIGTERM) 13:35:04.973112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10871): Terminating (SIGTERM) 13:35:05.015360 run iperf3-srv_10.42.42.10(pid=10872): Terminating (SIGTERM) 13:35:05.057434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10875): Terminating (SIGTERM) 13:35:05.100300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10881): Terminating (SIGTERM) 13:35:05.145025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10884): Terminating (SIGTERM) 13:35:05.187547 --- ParallelTerminationStrategy: PID 10865 died... 13:35:05.208017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10865): Terminated: ok {rc=0} 13:35:05.255031 --- ParallelTerminationStrategy: PID 10866 died... 13:35:05.274764 run iperf3-srv_10.42.42.10(pid=10866): Terminated {rc=256} 13:35:05.321746 --- ParallelTerminationStrategy: PID 10867 died... 13:35:05.341437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10867): Terminated: ok {rc=0} 13:35:05.388669 --- ParallelTerminationStrategy: PID 10868 died... 13:35:05.408607 run iperf3-srv_10.42.42.10(pid=10868): Terminated {rc=256} 13:35:05.456211 --- ParallelTerminationStrategy: PID 10869 died... 13:35:05.475957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10869): Terminated: ok {rc=0} 13:35:05.522824 --- ParallelTerminationStrategy: PID 10870 died... 13:35:05.542482 run iperf3-srv_10.42.42.10(pid=10870): Terminated {rc=256} 13:35:05.589330 --- ParallelTerminationStrategy: PID 10871 died... 13:35:05.609017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10871): Terminated: ok {rc=0} 13:35:05.656757 --- ParallelTerminationStrategy: PID 10872 died... 13:35:05.676846 run iperf3-srv_10.42.42.10(pid=10872): Terminated {rc=256} 13:35:05.723913 --- ParallelTerminationStrategy: PID 10875 died... 13:35:05.743508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10875): Terminated: ok {rc=0} 13:35:05.790017 --- ParallelTerminationStrategy: PID 10881 died... 13:35:05.809589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10881): Terminated: ok {rc=0} 13:35:05.856442 --- ParallelTerminationStrategy: PID 10884 died... 13:35:05.876164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10884): Terminated: ok {rc=0} 13:35:05.963715 bus /gobi_4: Setting Powered False 13:35:07.063506 bus /gobi_4: Setting Powered False 13:35:08.180384 bus /gobi_1: Setting Powered False 13:35:09.280233 bus /gobi_1: Setting Powered False 13:35:10.395531 bus /gobi_0: Setting Powered False 13:35:11.494730 bus /gobi_0: Setting Powered False 13:35:12.612407 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms ping.py ---------------------------------------------- 13:35:13.715617 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:35:13.727394 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:35:13.778515 tst ping.py: using LAC 21813 13:35:13.903933 tst ping.py: using RAC 138 13:35:14.026050 tst ping.py: using CellId 21813 13:35:14.148346 tst ping.py: using BVCI 21814 13:35:14.262288 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:35:14.273360 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:35:14.284235 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:35:14.295346 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:35:14.306420 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:35:14.317524 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:35:14.328726 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:35:14.339880 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:35:14.457368 tst ping.py:19: start network... 13:35:14.668916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:15.155483 run create_hlr_db(pid=10893): Launched 13:35:15.275278 bus /gobi_6: Setting Powered False 13:35:16.339414 run create_hlr_db(pid=10893): Terminated: ok {rc=0} 13:35:16.816285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10895): Launched 13:35:17.184426 run osmo-hlr_10.42.42.2(pid=10896): Launched 13:35:17.329824 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:17.876328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10898): Launched 13:35:18.191850 run osmo-stp_10.42.42.5(pid=10899): Launched 13:35:18.311650 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:35:18.853798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10901): Launched 13:35:18.975095 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:35:19.240461 run patchelf(pid=10902): Launched 13:35:19.416308 run osmo-stp_10.42.42.5(pid=10899): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10899)] 13:35:19.551281 run osmo-stp_10.42.42.5(pid=10899): stdout: | (launched: 2022-12-09_13:35:18.133968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:19.686779 run osmo-stp_10.42.42.5(pid=10899): stderr: | 20221209133518324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133518324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133518325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133518325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133518326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133518326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133518326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:19.822224 run osmo-stp_10.42.42.5(pid=10899): stdout: | (launched: 2022-12-09_13:35:18.133968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:19.951772 run osmo-stp_10.42.42.5(pid=10899): stderr: | 20221209133518324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133518324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133518325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133518325 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133518326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133518326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133518326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:20.105505 run patchelf(pid=10902): Terminating (SIGINT) 13:35:20.282246 run patchelf(pid=10902): Terminated: ok {rc=0} 13:35:20.409479 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10899): Process ended prematurely: osmo-stp_10.42.42.5(pid=10899) [trial-2360↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10899)] [trial-2360↪gprs:trx-lms↪ping.py:22] 13:35:20.419004 tst ping.py:22: Test FAILED (6.7 sec) 13:35:20.447867 run osmo-hlr_10.42.42.2(pid=10896): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10896)] 13:35:20.498093 run osmo-hlr_10.42.42.2(pid=10896): stdout: | (launched: 2022-12-09_13:35:17.129397) 13:35:20.550075 run osmo-hlr_10.42.42.2(pid=10896): stderr: | 20221209133517350 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133517350 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133517350 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133517350 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133517350 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133517350 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133517362 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133517371 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133517371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133517371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:20.602661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10895): Terminating (SIGTERM) 13:35:20.644864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10898): Terminating (SIGTERM) 13:35:20.687099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10901): Terminating (SIGTERM) 13:35:20.729497 --- ParallelTerminationStrategy: PID 10895 died... 13:35:20.749547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10895): Terminated: ok {rc=0} 13:35:20.796285 --- ParallelTerminationStrategy: PID 10898 died... 13:35:20.815883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10898): Terminated: ok {rc=0} 13:35:20.862292 --- ParallelTerminationStrategy: PID 10901 died... 13:35:20.881878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10901): Terminated: ok {rc=0} 13:35:20.969374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 13:35:22.056571 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:35:22.068149 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:35:22.119429 tst ping_idle_ping.py: using LAC 21814 13:35:22.243353 tst ping_idle_ping.py: using RAC 139 13:35:22.360130 tst ping_idle_ping.py: using CellId 21814 13:35:22.474679 tst ping_idle_ping.py: using BVCI 21815 13:35:22.581979 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:35:22.592437 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:35:22.602879 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:35:22.613720 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:35:22.624409 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:35:22.635215 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:35:22.646140 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:35:22.657000 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:35:22.771963 tst ping_idle_ping.py:24: start network... 13:35:22.968521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:23.427460 run create_hlr_db(pid=10903): Launched 13:35:23.549882 bus /gobi_6: Setting Powered False 13:35:24.609924 run create_hlr_db(pid=10903): Terminated: ok {rc=0} 13:35:25.044631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10905): Launched 13:35:25.363022 run osmo-hlr_10.42.42.2(pid=10906): Launched 13:35:25.486773 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:26.032863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10920): Launched 13:35:26.349570 run osmo-stp_10.42.42.5(pid=10921): Launched 13:35:26.471579 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:35:27.017024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10923): Launched 13:35:27.139777 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:35:27.406733 run patchelf(pid=10924): Launched 13:35:27.585411 run osmo-stp_10.42.42.5(pid=10921): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10921)] 13:35:27.719673 run osmo-stp_10.42.42.5(pid=10921): stdout: | (launched: 2022-12-09_13:35:26.291775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:27.855641 run osmo-stp_10.42.42.5(pid=10921): stderr: | 20221209133526482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133526482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133526483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133526483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133526483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133526484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133526484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:27.991696 run osmo-stp_10.42.42.5(pid=10921): stdout: | (launched: 2022-12-09_13:35:26.291775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:28.122062 run osmo-stp_10.42.42.5(pid=10921): stderr: | 20221209133526482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133526482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133526483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133526483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133526483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133526484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133526484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:28.275779 run patchelf(pid=10924): Terminating (SIGINT) 13:35:28.452806 run patchelf(pid=10924): Terminated: ok {rc=0} 13:35:28.579990 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10921): Process ended prematurely: osmo-stp_10.42.42.5(pid=10921) [trial-2360↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10921)] [trial-2360↪gprs:trx-lms↪ping_idle_ping.py:27] 13:35:28.589754 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:35:28.618113 run osmo-hlr_10.42.42.2(pid=10906): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10906)] 13:35:28.668554 run osmo-hlr_10.42.42.2(pid=10906): stdout: | (launched: 2022-12-09_13:35:25.304829) 13:35:28.720664 run osmo-hlr_10.42.42.2(pid=10906): stderr: | 20221209133525500 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133525500 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133525500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133525500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133525500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133525500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133525512 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133525520 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133525520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133525520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:28.773270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10905): Terminating (SIGTERM) 13:35:28.815172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10920): Terminating (SIGTERM) 13:35:28.857774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10923): Terminating (SIGTERM) 13:35:28.900082 --- ParallelTerminationStrategy: PID 10905 died... 13:35:28.920004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10905): Terminated: ok {rc=0} 13:35:28.967099 --- ParallelTerminationStrategy: PID 10920 died... 13:35:28.986734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10920): Terminated: ok {rc=0} 13:35:29.033377 --- ParallelTerminationStrategy: PID 10923 died... 13:35:29.053015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10923): Terminated: ok {rc=0} 13:35:29.142032 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 13:35:30.448709 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:35:30.454842 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:35:30.489373 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:35:30.528830 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:35:30.617294 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:35:30.651315 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:35:30.691054 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:35:31.313518 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:35:31.369959 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:31.381526 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:35:31.433681 tst cs_paging_gprs_active.py: using LAC 21815 13:35:31.557381 tst cs_paging_gprs_active.py: using RAC 140 13:35:31.725319 tst cs_paging_gprs_active.py: using CellId 21815 13:35:31.853797 tst cs_paging_gprs_active.py: using BVCI 21816 13:35:32.021475 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:32.037825 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:32.048810 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:32.060770 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:32.072468 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:32.084438 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:32.096261 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:32.107986 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:32.120860 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:35:32.237408 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:35:32.350368 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:35:32.554409 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:32.857698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10928): Launched 13:35:33.120336 run iperf3-srv_10.42.42.10(pid=10929): Launched 13:35:33.235184 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:35:33.436936 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:33.739965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10930): Launched 13:35:34.002141 run iperf3-srv_10.42.42.10(pid=10931): Launched 13:35:34.117113 tst cs_paging_gprs_active.py:38: start network... 13:35:34.318614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:34.785526 run create_hlr_db(pid=10932): Launched 13:35:34.908000 bus /gobi_6: Setting Powered False 13:35:35.968724 run create_hlr_db(pid=10932): Terminated: ok {rc=0} 13:35:36.407913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10934): Launched 13:35:36.730492 run osmo-hlr_10.42.42.2(pid=10935): Launched 13:35:36.855023 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:37.408846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10937): Launched 13:35:37.728627 run osmo-stp_10.42.42.5(pid=10938): Launched 13:35:37.850867 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:35:38.405902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10940): Launched 13:35:38.530399 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:35:38.800443 run patchelf(pid=10941): Launched 13:35:38.979769 run osmo-stp_10.42.42.5(pid=10938): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10938)] 13:35:39.115685 run osmo-stp_10.42.42.5(pid=10938): stdout: | (launched: 2022-12-09_13:35:37.670155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:39.253369 run osmo-stp_10.42.42.5(pid=10938): stderr: | 20221209133537860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133537861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133537861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133537861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133537862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133537862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133537862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:39.391038 run osmo-stp_10.42.42.5(pid=10938): stdout: | (launched: 2022-12-09_13:35:37.670155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:39.523483 run osmo-stp_10.42.42.5(pid=10938): stderr: | 20221209133537860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133537861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133537861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133537861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133537862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133537862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133537862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:39.679463 run patchelf(pid=10941): Terminating (SIGINT) 13:35:39.858982 run patchelf(pid=10941): Terminated: ok {rc=0} 13:35:39.988393 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10938): Process ended prematurely: osmo-stp_10.42.42.5(pid=10938) [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10938)] [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:35:39.998541 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:35:40.027185 run osmo-hlr_10.42.42.2(pid=10935): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10935)] 13:35:40.077515 run osmo-hlr_10.42.42.2(pid=10935): stdout: | (launched: 2022-12-09_13:35:36.671530) 13:35:40.129308 run osmo-hlr_10.42.42.2(pid=10935): stderr: | 20221209133536869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133536869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133536869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133536869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133536869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133536869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133536881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133536889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133536890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133536890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:40.181450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10928): Terminating (SIGTERM) 13:35:40.223215 run iperf3-srv_10.42.42.10(pid=10929): Terminating (SIGTERM) 13:35:40.264810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10930): Terminating (SIGTERM) 13:35:40.306639 run iperf3-srv_10.42.42.10(pid=10931): Terminating (SIGTERM) 13:35:40.348359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10934): Terminating (SIGTERM) 13:35:40.390170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10937): Terminating (SIGTERM) 13:35:40.431943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10940): Terminating (SIGTERM) 13:35:40.474422 --- ParallelTerminationStrategy: PID 10928 died... 13:35:40.494312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10928): Terminated: ok {rc=0} 13:35:40.540751 --- ParallelTerminationStrategy: PID 10929 died... 13:35:40.560271 run iperf3-srv_10.42.42.10(pid=10929): Terminated {rc=256} 13:35:40.606367 --- ParallelTerminationStrategy: PID 10930 died... 13:35:40.625705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10930): Terminated: ok {rc=0} 13:35:40.671951 --- ParallelTerminationStrategy: PID 10931 died... 13:35:40.691380 run iperf3-srv_10.42.42.10(pid=10931): Terminated {rc=256} 13:35:40.737487 --- ParallelTerminationStrategy: PID 10934 died... 13:35:40.757012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10934): Terminated: ok {rc=0} 13:35:40.803420 --- ParallelTerminationStrategy: PID 10937 died... 13:35:40.822948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10937): Terminated: ok {rc=0} 13:35:40.869262 --- ParallelTerminationStrategy: PID 10940 died... 13:35:40.888603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10940): Terminated: ok {rc=0} 13:35:40.976785 bus /gobi_0: Setting Powered False 13:35:42.075935 bus /gobi_0: Setting Powered False 13:35:43.192081 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:35:44.341056 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:44.353008 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:35:44.405432 tst iperf3.py: using LAC 21816 13:35:44.533135 tst iperf3.py: using RAC 141 13:35:44.657802 tst iperf3.py: using CellId 21816 13:35:44.782533 tst iperf3.py: using BVCI 21817 13:35:44.899062 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:44.910474 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:44.921645 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:44.932826 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:44.944113 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:44.955526 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:44.967156 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:44.978419 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:44.989900 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:35:45.104481 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:35:45.305514 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:45.607398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10942): Launched 13:35:45.868793 run iperf3-srv_10.42.42.10(pid=10943): Launched 13:35:46.020474 tst iperf3.py:8: start network... 13:35:46.247238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:46.762468 run create_hlr_db(pid=10944): Launched 13:35:46.921829 bus /gobi_6: Setting Powered False 13:35:47.981732 run create_hlr_db(pid=10944): Terminated: ok {rc=0} 13:35:48.426645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10946): Launched 13:35:48.748394 run osmo-hlr_10.42.42.2(pid=10947): Launched 13:35:48.870944 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:49.422951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10949): Launched 13:35:49.744748 run osmo-stp_10.42.42.5(pid=10950): Launched 13:35:49.868367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:35:50.420916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10952): Launched 13:35:50.543773 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:35:50.814061 run patchelf(pid=10953): Launched 13:35:50.992409 run osmo-stp_10.42.42.5(pid=10950): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10950)] 13:35:51.128339 run osmo-stp_10.42.42.5(pid=10950): stdout: | (launched: 2022-12-09_13:35:49.686345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:51.265571 run osmo-stp_10.42.42.5(pid=10950): stderr: | 20221209133549878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133549879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133549879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133549879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133549880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133549880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133549880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:51.403160 run osmo-stp_10.42.42.5(pid=10950): stdout: | (launched: 2022-12-09_13:35:49.686345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:51.535183 run osmo-stp_10.42.42.5(pid=10950): stderr: | 20221209133549878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133549879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133549879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133549879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133549880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133549880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133549880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:51.692148 run patchelf(pid=10953): Terminating (SIGINT) 13:35:51.871109 run patchelf(pid=10953): Terminated: ok {rc=0} 13:35:52.000375 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10950): Process ended prematurely: osmo-stp_10.42.42.5(pid=10950) [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10950)] [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 13:35:52.010553 tst iperf3.py:8: Test FAILED (7.7 sec) 13:35:52.039009 run osmo-hlr_10.42.42.2(pid=10947): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10947)] 13:35:52.088863 run osmo-hlr_10.42.42.2(pid=10947): stdout: | (launched: 2022-12-09_13:35:48.689881) 13:35:52.140502 run osmo-hlr_10.42.42.2(pid=10947): stderr: | 20221209133548887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133548887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133548887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133548887 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133548887 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133548887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133548901 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133548909 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133548909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133548909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:52.192552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10942): Terminating (SIGTERM) 13:35:52.234257 run iperf3-srv_10.42.42.10(pid=10943): Terminating (SIGTERM) 13:35:52.275807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10946): Terminating (SIGTERM) 13:35:52.317535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10949): Terminating (SIGTERM) 13:35:52.359419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10952): Terminating (SIGTERM) 13:35:52.401388 --- ParallelTerminationStrategy: PID 10942 died... 13:35:52.421254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10942): Terminated: ok {rc=0} 13:35:52.468407 --- ParallelTerminationStrategy: PID 10943 died... 13:35:52.488191 run iperf3-srv_10.42.42.10(pid=10943): Terminated {rc=256} 13:35:52.534886 --- ParallelTerminationStrategy: PID 10946 died... 13:35:52.554367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10946): Terminated: ok {rc=0} 13:35:52.600469 --- ParallelTerminationStrategy: PID 10949 died... 13:35:52.620016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10949): Terminated: ok {rc=0} 13:35:52.666238 --- ParallelTerminationStrategy: PID 10952 died... 13:35:52.685807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10952): Terminated: ok {rc=0} 13:35:52.773899 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:35:53.923161 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:53.935074 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:35:53.999311 tst iperf3m4.py: using LAC 21817 13:35:54.131086 tst iperf3m4.py: using RAC 142 13:35:54.256040 tst iperf3m4.py: using CellId 21817 13:35:54.380511 tst iperf3m4.py: using BVCI 21818 13:35:54.497930 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:54.509189 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:54.520375 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:54.531663 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:54.542905 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:54.554028 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:54.565505 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:54.576182 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:35:54.587777 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:35:54.704003 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:35:54.825311 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:35:54.941502 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:35:55.057054 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:35:55.259861 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:55.562004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10954): Launched 13:35:55.827110 run iperf3-srv_10.42.42.10(pid=10955): Launched 13:35:55.940228 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:35:56.141166 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:56.442518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10956): Launched 13:35:56.703582 run iperf3-srv_10.42.42.10(pid=10957): Launched 13:35:56.816574 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:35:57.017365 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:57.319285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10958): Launched 13:35:57.581246 run iperf3-srv_10.42.42.10(pid=10959): Launched 13:35:57.694900 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:35:57.894718 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:58.195540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10960): Launched 13:35:58.456751 run iperf3-srv_10.42.42.10(pid=10961): Launched 13:35:58.569533 tst iperf3m4.py:8: start network... 13:35:58.770223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:59.237398 run create_hlr_db(pid=10962): Launched 13:35:59.361578 bus /gobi_6: Setting Powered False 13:36:00.422432 run create_hlr_db(pid=10962): Terminated: ok {rc=0} 13:36:00.863955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10965): Launched 13:36:01.188603 run osmo-hlr_10.42.42.2(pid=10966): Launched 13:36:01.331428 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:02.079268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10968): Launched 13:36:02.441772 run osmo-stp_10.42.42.5(pid=10969): Launched 13:36:02.567469 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:36:03.121996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10971): Launched 13:36:03.246099 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:36:03.517906 run patchelf(pid=10972): Launched 13:36:03.698393 run osmo-stp_10.42.42.5(pid=10969): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10969)] 13:36:03.834713 run osmo-stp_10.42.42.5(pid=10969): stdout: | (launched: 2022-12-09_13:36:02.383206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:03.972077 run osmo-stp_10.42.42.5(pid=10969): stderr: | 20221209133602572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133602572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133602573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133602573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133602574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133602574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133602574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:04.109834 run osmo-stp_10.42.42.5(pid=10969): stdout: | (launched: 2022-12-09_13:36:02.383206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:04.242036 run osmo-stp_10.42.42.5(pid=10969): stderr: | 20221209133602572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133602572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133602573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133602573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133602574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133602574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133602574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:04.398760 run patchelf(pid=10972): Terminating (SIGINT) 13:36:04.578553 run patchelf(pid=10972): Terminated: ok {rc=0} 13:36:04.707859 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10969): Process ended prematurely: osmo-stp_10.42.42.5(pid=10969) [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10969)] [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 13:36:04.718082 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:36:04.747249 run osmo-hlr_10.42.42.2(pid=10966): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10966)] 13:36:04.797753 run osmo-hlr_10.42.42.2(pid=10966): stdout: | (launched: 2022-12-09_13:36:01.130324) 13:36:04.850150 run osmo-hlr_10.42.42.2(pid=10966): stderr: | 20221209133601482 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133601482 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133601482 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133601482 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133601482 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133601482 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133601506 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133601531 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133601531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133601531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:04.902625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10954): Terminating (SIGTERM) 13:36:04.944769 run iperf3-srv_10.42.42.10(pid=10955): Terminating (SIGTERM) 13:36:04.987031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10956): Terminating (SIGTERM) 13:36:05.029197 run iperf3-srv_10.42.42.10(pid=10957): Terminating (SIGTERM) 13:36:05.071119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10958): Terminating (SIGTERM) 13:36:05.113577 run iperf3-srv_10.42.42.10(pid=10959): Terminating (SIGTERM) 13:36:05.156016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10960): Terminating (SIGTERM) 13:36:05.198091 run iperf3-srv_10.42.42.10(pid=10961): Terminating (SIGTERM) 13:36:05.240247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10965): Terminating (SIGTERM) 13:36:05.282396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10968): Terminating (SIGTERM) 13:36:05.324452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10971): Terminating (SIGTERM) 13:36:05.366556 --- ParallelTerminationStrategy: PID 10954 died... 13:36:05.386542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10954): Terminated: ok {rc=0} 13:36:05.433060 --- ParallelTerminationStrategy: PID 10955 died... 13:36:05.452372 run iperf3-srv_10.42.42.10(pid=10955): Terminated {rc=256} 13:36:05.499007 --- ParallelTerminationStrategy: PID 10956 died... 13:36:05.518492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10956): Terminated: ok {rc=0} 13:36:05.565155 --- ParallelTerminationStrategy: PID 10957 died... 13:36:05.584605 run iperf3-srv_10.42.42.10(pid=10957): Terminated {rc=256} 13:36:05.630799 --- ParallelTerminationStrategy: PID 10958 died... 13:36:05.650269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10958): Terminated: ok {rc=0} 13:36:05.697162 --- ParallelTerminationStrategy: PID 10959 died... 13:36:05.716638 run iperf3-srv_10.42.42.10(pid=10959): Terminated {rc=256} 13:36:05.762759 --- ParallelTerminationStrategy: PID 10960 died... 13:36:05.782223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10960): Terminated: ok {rc=0} 13:36:05.828793 --- ParallelTerminationStrategy: PID 10961 died... 13:36:05.848757 run iperf3-srv_10.42.42.10(pid=10961): Terminated {rc=256} 13:36:05.895200 --- ParallelTerminationStrategy: PID 10965 died... 13:36:05.914790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10965): Terminated: ok {rc=0} 13:36:05.961206 --- ParallelTerminationStrategy: PID 10968 died... 13:36:05.980620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10968): Terminated: ok {rc=0} 13:36:06.027101 --- ParallelTerminationStrategy: PID 10971 died... 13:36:06.046837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10971): Terminated: ok {rc=0} 13:36:06.134854 bus /gobi_4: Setting Powered False 13:36:07.234628 bus /gobi_4: Setting Powered False 13:36:08.350574 bus /gobi_1: Setting Powered False 13:36:09.449742 bus /gobi_1: Setting Powered False 13:36:10.567943 bus /gobi_0: Setting Powered False 13:36:11.667023 bus /gobi_0: Setting Powered False 13:36:12.781483 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 13:36:13.884316 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:36:13.896262 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:36:13.952570 tst ping.py: using LAC 21818 13:36:14.074805 tst ping.py: using RAC 143 13:36:14.196110 tst ping.py: using CellId 21818 13:36:14.319251 tst ping.py: using BVCI 21819 13:36:14.433672 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:36:14.444928 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:36:14.456104 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:36:14.467583 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:36:14.479201 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:36:14.490505 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:36:14.502210 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:36:14.513700 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:36:14.628573 tst ping.py:19: start network... 13:36:14.826162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:15.281798 run create_hlr_db(pid=10973): Launched 13:36:15.403260 bus /gobi_6: Setting Powered False 13:36:16.464207 run create_hlr_db(pid=10973): Terminated: ok {rc=0} 13:36:16.886974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10975): Launched 13:36:17.200330 run osmo-hlr_10.42.42.2(pid=10976): Launched 13:36:17.313892 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:17.836009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10978): Launched 13:36:18.130314 run osmo-stp_10.42.42.5(pid=10979): Launched 13:36:18.240813 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:36:18.762523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10981): Launched 13:36:18.877051 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:36:19.125206 run patchelf(pid=10982): Launched 13:36:19.301113 run osmo-stp_10.42.42.5(pid=10979): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10979)] 13:36:19.435197 run osmo-stp_10.42.42.5(pid=10979): stdout: | (launched: 2022-12-09_13:36:18.075018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:19.571582 run osmo-stp_10.42.42.5(pid=10979): stderr: | 20221209133618244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133618244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133618245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133618245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133618245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133618245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133618246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:19.707329 run osmo-stp_10.42.42.5(pid=10979): stdout: | (launched: 2022-12-09_13:36:18.075018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:19.837840 run osmo-stp_10.42.42.5(pid=10979): stderr: | 20221209133618244 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133618244 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133618245 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133618245 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133618245 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133618245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133618246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:19.991274 run patchelf(pid=10982): Terminating (SIGINT) 13:36:20.167512 run patchelf(pid=10982): Terminated: ok {rc=0} 13:36:20.294871 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10979): Process ended prematurely: osmo-stp_10.42.42.5(pid=10979) [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10979)] [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 13:36:20.304441 tst ping.py:22: Test FAILED (6.4 sec) 13:36:20.333368 run osmo-hlr_10.42.42.2(pid=10976): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10976)] 13:36:20.383824 run osmo-hlr_10.42.42.2(pid=10976): stdout: | (launched: 2022-12-09_13:36:17.145091) 13:36:20.436116 run osmo-hlr_10.42.42.2(pid=10976): stderr: | 20221209133617322 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133617322 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133617322 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133617322 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133617322 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133617322 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133617335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133617344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133617344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133617344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:20.489376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10975): Terminating (SIGTERM) 13:36:20.532021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10978): Terminating (SIGTERM) 13:36:20.574837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10981): Terminating (SIGTERM) 13:36:20.618077 --- ParallelTerminationStrategy: PID 10975 died... 13:36:20.638602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10975): Terminated: ok {rc=0} 13:36:20.686403 --- ParallelTerminationStrategy: PID 10978 died... 13:36:20.706526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10978): Terminated: ok {rc=0} 13:36:20.753826 --- ParallelTerminationStrategy: PID 10981 died... 13:36:20.773870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10981): Terminated: ok {rc=0} 13:36:20.863355 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:36:21.948480 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:36:21.960872 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:36:22.014441 tst ping_idle_ping.py: using LAC 21819 13:36:22.139328 tst ping_idle_ping.py: using RAC 144 13:36:22.262744 tst ping_idle_ping.py: using CellId 21819 13:36:22.386421 tst ping_idle_ping.py: using BVCI 21820 13:36:22.501259 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:36:22.512614 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:36:22.523914 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:36:22.535391 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:36:22.546805 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:36:22.558060 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:36:22.569735 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:36:22.581146 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:36:22.696566 tst ping_idle_ping.py:24: start network... 13:36:22.895814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:23.356856 run create_hlr_db(pid=10983): Launched 13:36:23.478764 bus /gobi_6: Setting Powered False 13:36:24.538341 run create_hlr_db(pid=10983): Terminated: ok {rc=0} 13:36:24.971382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10985): Launched 13:36:25.285267 run osmo-hlr_10.42.42.2(pid=10986): Launched 13:36:25.399305 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:25.921500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10988): Launched 13:36:26.218117 run osmo-stp_10.42.42.5(pid=10989): Launched 13:36:26.330732 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:36:26.842196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10992): Launched 13:36:26.954683 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:36:27.204100 run patchelf(pid=10993): Launched 13:36:27.367972 run osmo-stp_10.42.42.5(pid=10989): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10989)] 13:36:27.493243 run osmo-stp_10.42.42.5(pid=10989): stdout: | (launched: 2022-12-09_13:36:26.163569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:27.620070 run osmo-stp_10.42.42.5(pid=10989): stderr: | 20221209133626334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133626334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133626334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133626335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133626335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133626335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133626335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:27.747150 run osmo-stp_10.42.42.5(pid=10989): stdout: | (launched: 2022-12-09_13:36:26.163569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:27.868552 run osmo-stp_10.42.42.5(pid=10989): stderr: | 20221209133626334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133626334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133626334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133626335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133626335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133626335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133626335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:28.012258 run patchelf(pid=10993): Terminating (SIGINT) 13:36:28.178407 run patchelf(pid=10993): Terminated: ok {rc=0} 13:36:28.297570 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10989): Process ended prematurely: osmo-stp_10.42.42.5(pid=10989) [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10989)] [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 13:36:28.306372 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:36:28.332885 run osmo-hlr_10.42.42.2(pid=10986): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10986)] 13:36:28.380261 run osmo-hlr_10.42.42.2(pid=10986): stdout: | (launched: 2022-12-09_13:36:25.230950) 13:36:28.429192 run osmo-hlr_10.42.42.2(pid=10986): stderr: | 20221209133625406 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133625406 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133625406 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133625406 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133625406 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133625406 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133625418 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133625427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133625428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133625428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:28.478602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10985): Terminating (SIGTERM) 13:36:28.518445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10988): Terminating (SIGTERM) 13:36:28.558314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10992): Terminating (SIGTERM) 13:36:28.598728 --- ParallelTerminationStrategy: PID 10985 died... 13:36:28.618092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10985): Terminated: ok {rc=0} 13:36:28.662465 --- ParallelTerminationStrategy: PID 10988 died... 13:36:28.681622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10988): Terminated: ok {rc=0} 13:36:28.725690 --- ParallelTerminationStrategy: PID 10992 died... 13:36:28.744490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10992): Terminated: ok {rc=0} 13:36:28.828774 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:36:30.138661 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:36:30.145077 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:36:30.178207 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:36:30.216648 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:36:30.303010 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:36:30.335728 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:36:30.373827 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:36:30.977309 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:36:31.027777 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:31.039631 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:36:31.108233 tst cs_paging_gprs_active.py: using LAC 21820 13:36:31.228909 tst cs_paging_gprs_active.py: using RAC 145 13:36:31.368135 tst cs_paging_gprs_active.py: using CellId 21820 13:36:31.538903 tst cs_paging_gprs_active.py: using BVCI 21821 13:36:31.659783 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:31.672513 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:31.686260 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:31.699576 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:31.713342 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:31.726577 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:31.739636 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:31.753818 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:31.767224 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:36:31.912348 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:36:32.067920 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:36:32.308776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:36:32.612616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10998): Launched 13:36:32.873822 run iperf3-srv_10.42.42.10(pid=10999): Launched 13:36:32.985705 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:36:33.186155 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:36:33.486690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11000): Launched 13:36:33.748890 run iperf3-srv_10.42.42.10(pid=11001): Launched 13:36:33.861183 tst cs_paging_gprs_active.py:38: start network... 13:36:34.062259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:34.528459 run create_hlr_db(pid=11002): Launched 13:36:34.651703 bus /gobi_6: Setting Powered False 13:36:35.711694 run create_hlr_db(pid=11002): Terminated: ok {rc=0} 13:36:36.150462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11004): Launched 13:36:36.472570 run osmo-hlr_10.42.42.2(pid=11005): Launched 13:36:36.597274 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:37.150899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11007): Launched 13:36:37.471993 run osmo-stp_10.42.42.5(pid=11008): Launched 13:36:37.596395 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:36:38.151398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11010): Launched 13:36:38.275326 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:36:38.554095 run patchelf(pid=11011): Launched 13:36:38.733083 run osmo-stp_10.42.42.5(pid=11008): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11008)] 13:36:38.869082 run osmo-stp_10.42.42.5(pid=11008): stdout: | (launched: 2022-12-09_13:36:37.413458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:39.006601 run osmo-stp_10.42.42.5(pid=11008): stderr: | 20221209133637606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133637606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133637606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133637606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133637607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133637607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133637607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:39.144324 run osmo-stp_10.42.42.5(pid=11008): stdout: | (launched: 2022-12-09_13:36:37.413458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:39.276214 run osmo-stp_10.42.42.5(pid=11008): stderr: | 20221209133637606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133637606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133637606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133637606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133637607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133637607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133637607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:39.432481 run patchelf(pid=11011): Terminating (SIGINT) 13:36:39.612677 run patchelf(pid=11011): Terminated: ok {rc=0} 13:36:39.742446 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11008): Process ended prematurely: osmo-stp_10.42.42.5(pid=11008) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11008)] [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:36:39.752516 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:36:39.781585 run osmo-hlr_10.42.42.2(pid=11005): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11005)] 13:36:39.831517 run osmo-hlr_10.42.42.2(pid=11005): stdout: | (launched: 2022-12-09_13:36:36.414083) 13:36:39.883147 run osmo-hlr_10.42.42.2(pid=11005): stderr: | 20221209133636612 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133636612 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133636612 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133636612 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133636612 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133636612 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133636628 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133636638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133636638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133636638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:39.935323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10998): Terminating (SIGTERM) 13:36:39.978421 run iperf3-srv_10.42.42.10(pid=10999): Terminating (SIGTERM) 13:36:40.020444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11000): Terminating (SIGTERM) 13:36:40.062494 run iperf3-srv_10.42.42.10(pid=11001): Terminating (SIGTERM) 13:36:40.104276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11004): Terminating (SIGTERM) 13:36:40.146188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11007): Terminating (SIGTERM) 13:36:40.187860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11010): Terminating (SIGTERM) 13:36:40.230098 --- ParallelTerminationStrategy: PID 10998 died... 13:36:40.250108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10998): Terminated: ok {rc=0} 13:36:40.296661 --- ParallelTerminationStrategy: PID 10999 died... 13:36:40.316355 run iperf3-srv_10.42.42.10(pid=10999): Terminated {rc=256} 13:36:40.362715 --- ParallelTerminationStrategy: PID 11000 died... 13:36:40.382331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11000): Terminated: ok {rc=0} 13:36:40.428501 --- ParallelTerminationStrategy: PID 11001 died... 13:36:40.448134 run iperf3-srv_10.42.42.10(pid=11001): Terminated {rc=256} 13:36:40.494730 --- ParallelTerminationStrategy: PID 11004 died... 13:36:40.514416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11004): Terminated: ok {rc=0} 13:36:40.561037 --- ParallelTerminationStrategy: PID 11007 died... 13:36:40.580538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11007): Terminated: ok {rc=0} 13:36:40.626234 --- ParallelTerminationStrategy: PID 11010 died... 13:36:40.645644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11010): Terminated: ok {rc=0} 13:36:40.733248 bus /gobi_0: Setting Powered False 13:36:41.832469 bus /gobi_0: Setting Powered False 13:36:42.949765 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:36:44.095308 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:44.106940 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:36:44.176558 tst iperf3.py: using LAC 21821 13:36:44.295319 tst iperf3.py: using RAC 146 13:36:44.416121 tst iperf3.py: using CellId 21821 13:36:44.535620 tst iperf3.py: using BVCI 21822 13:36:44.646720 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:44.657653 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:44.668280 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:44.678905 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:44.689431 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:44.700032 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:44.710734 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:44.721214 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:44.731876 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:36:44.848801 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:36:45.065759 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:36:45.388075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11012): Launched 13:36:45.667465 run iperf3-srv_10.42.42.10(pid=11013): Launched 13:36:45.788250 tst iperf3.py:8: start network... 13:36:46.017598 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:46.515558 run create_hlr_db(pid=11014): Launched 13:36:46.674884 bus /gobi_6: Setting Powered False 13:36:47.734382 run create_hlr_db(pid=11014): Terminated: ok {rc=0} 13:36:48.155912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11016): Launched 13:36:48.457163 run osmo-hlr_10.42.42.2(pid=11035): Launched 13:36:48.572294 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:49.105488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11038): Launched 13:36:49.406669 run osmo-stp_10.42.42.5(pid=11039): Launched 13:36:49.521479 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:36:50.043110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11041): Launched 13:36:50.158079 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:36:50.412211 run patchelf(pid=11042): Launched 13:36:50.579378 run osmo-stp_10.42.42.5(pid=11039): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11039)] 13:36:50.707193 run osmo-stp_10.42.42.5(pid=11039): stdout: | (launched: 2022-12-09_13:36:49.351327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:50.836441 run osmo-stp_10.42.42.5(pid=11039): stderr: | 20221209133649522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133649522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133649522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133649523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133649523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133649523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133649523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:50.966145 run osmo-stp_10.42.42.5(pid=11039): stdout: | (launched: 2022-12-09_13:36:49.351327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:51.089964 run osmo-stp_10.42.42.5(pid=11039): stderr: | 20221209133649522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133649522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133649522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133649523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133649523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133649523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133649523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:51.237162 run patchelf(pid=11042): Terminating (SIGINT) 13:36:51.405568 run patchelf(pid=11042): Terminated: ok {rc=0} 13:36:51.527839 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11039): Process ended prematurely: osmo-stp_10.42.42.5(pid=11039) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11039)] [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 13:36:51.537561 tst iperf3.py:8: Test FAILED (7.5 sec) 13:36:51.564656 run osmo-hlr_10.42.42.2(pid=11035): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11035)] 13:36:51.612384 run osmo-hlr_10.42.42.2(pid=11035): stdout: | (launched: 2022-12-09_13:36:48.401820) 13:36:51.661760 run osmo-hlr_10.42.42.2(pid=11035): stderr: | 20221209133648579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133648579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133648579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133648579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133648579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133648579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133648591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133648600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133648600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133648600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:51.711770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11012): Terminating (SIGTERM) 13:36:51.751804 run iperf3-srv_10.42.42.10(pid=11013): Terminating (SIGTERM) 13:36:51.791862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11016): Terminating (SIGTERM) 13:36:51.832011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11038): Terminating (SIGTERM) 13:36:51.872044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11041): Terminating (SIGTERM) 13:36:51.912733 --- ParallelTerminationStrategy: PID 11012 died... 13:36:51.932290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11012): Terminated: ok {rc=0} 13:36:51.977392 --- ParallelTerminationStrategy: PID 11013 died... 13:36:51.996244 run iperf3-srv_10.42.42.10(pid=11013): Terminated {rc=256} 13:36:52.040410 --- ParallelTerminationStrategy: PID 11016 died... 13:36:52.059796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11016): Terminated: ok {rc=0} 13:36:52.104317 --- ParallelTerminationStrategy: PID 11038 died... 13:36:52.123296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11038): Terminated: ok {rc=0} 13:36:52.168200 --- ParallelTerminationStrategy: PID 11041 died... 13:36:52.187407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11041): Terminated: ok {rc=0} 13:36:52.271098 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:36:53.413606 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:53.425174 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:36:53.496313 tst iperf3m4.py: using LAC 21822 13:36:53.617865 tst iperf3m4.py: using RAC 147 13:36:53.735604 tst iperf3m4.py: using CellId 21822 13:36:53.853927 tst iperf3m4.py: using BVCI 21823 13:36:53.963474 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:53.974550 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:53.985458 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:53.996129 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:54.006874 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:54.017738 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:54.028524 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:54.039201 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:36:54.050100 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:36:54.166397 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:36:54.283722 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:36:54.403641 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:36:54.520352 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:36:54.721393 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:36:55.022775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11043): Launched 13:36:55.284245 run iperf3-srv_10.42.42.10(pid=11045): Launched 13:36:55.396546 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:36:55.597289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:36:55.898903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11046): Launched 13:36:56.162548 run iperf3-srv_10.42.42.10(pid=11047): Launched 13:36:56.275115 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:36:56.475281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:36:56.776894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11048): Launched 13:36:57.038925 run iperf3-srv_10.42.42.10(pid=11049): Launched 13:36:57.151942 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:36:57.352908 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:36:57.653748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11050): Launched 13:36:57.914577 run iperf3-srv_10.42.42.10(pid=11051): Launched 13:36:58.029247 tst iperf3m4.py:8: start network... 13:36:58.229884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:58.695422 run create_hlr_db(pid=11052): Launched 13:36:58.818997 bus /gobi_6: Setting Powered False 13:36:59.879177 run create_hlr_db(pid=11052): Terminated: ok {rc=0} 13:37:00.318847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11054): Launched 13:37:00.641505 run osmo-hlr_10.42.42.2(pid=11055): Launched 13:37:00.766421 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:01.421179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11057): Launched 13:37:01.747806 run osmo-stp_10.42.42.5(pid=11058): Launched 13:37:02.088601 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:37:02.672396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11060): Launched 13:37:02.787334 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:37:03.041454 run patchelf(pid=11061): Launched 13:37:03.207919 run osmo-stp_10.42.42.5(pid=11058): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11058)] 13:37:03.335429 run osmo-stp_10.42.42.5(pid=11058): stdout: | (launched: 2022-12-09_13:37:01.685856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:03.464161 run osmo-stp_10.42.42.5(pid=11058): stderr: | 20221209133701914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133701914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133701915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133701916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133701917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133701917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133701917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:03.592707 run osmo-stp_10.42.42.5(pid=11058): stdout: | (launched: 2022-12-09_13:37:01.685856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:03.716162 run osmo-stp_10.42.42.5(pid=11058): stderr: | 20221209133701914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133701914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133701915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133701916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133701917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133701917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133701917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:03.862769 run patchelf(pid=11061): Terminating (SIGINT) 13:37:04.031133 run patchelf(pid=11061): Terminated: ok {rc=0} 13:37:04.153424 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11058): Process ended prematurely: osmo-stp_10.42.42.5(pid=11058) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11058)] [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:37:04.163321 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:37:04.190631 run osmo-hlr_10.42.42.2(pid=11055): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11055)] 13:37:04.237683 run osmo-hlr_10.42.42.2(pid=11055): stdout: | (launched: 2022-12-09_13:37:00.582923) 13:37:04.286658 run osmo-hlr_10.42.42.2(pid=11055): stderr: | 20221209133700778 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133700778 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133700778 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133700778 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133700778 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133700778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133700790 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133700799 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133700799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133700799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:04.336218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11043): Terminating (SIGTERM) 13:37:04.376651 run iperf3-srv_10.42.42.10(pid=11045): Terminating (SIGTERM) 13:37:04.416497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11046): Terminating (SIGTERM) 13:37:04.456715 run iperf3-srv_10.42.42.10(pid=11047): Terminating (SIGTERM) 13:37:04.496635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11048): Terminating (SIGTERM) 13:37:04.536654 run iperf3-srv_10.42.42.10(pid=11049): Terminating (SIGTERM) 13:37:04.576350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11050): Terminating (SIGTERM) 13:37:04.616417 run iperf3-srv_10.42.42.10(pid=11051): Terminating (SIGTERM) 13:37:04.655962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11054): Terminating (SIGTERM) 13:37:04.695550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11057): Terminating (SIGTERM) 13:37:04.735568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11060): Terminating (SIGTERM) 13:37:04.776178 --- ParallelTerminationStrategy: PID 11043 died... 13:37:04.795536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11043): Terminated: ok {rc=0} 13:37:04.840100 --- ParallelTerminationStrategy: PID 11045 died... 13:37:04.859111 run iperf3-srv_10.42.42.10(pid=11045): Terminated {rc=256} 13:37:04.903578 --- ParallelTerminationStrategy: PID 11046 died... 13:37:04.922573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11046): Terminated: ok {rc=0} 13:37:04.966528 --- ParallelTerminationStrategy: PID 11047 died... 13:37:04.985268 run iperf3-srv_10.42.42.10(pid=11047): Terminated {rc=256} 13:37:05.030256 --- ParallelTerminationStrategy: PID 11048 died... 13:37:05.049136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11048): Terminated: ok {rc=0} 13:37:05.093316 --- ParallelTerminationStrategy: PID 11049 died... 13:37:05.112203 run iperf3-srv_10.42.42.10(pid=11049): Terminated {rc=256} 13:37:05.156438 --- ParallelTerminationStrategy: PID 11050 died... 13:37:05.175515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11050): Terminated: ok {rc=0} 13:37:05.219774 --- ParallelTerminationStrategy: PID 11051 died... 13:37:05.238773 run iperf3-srv_10.42.42.10(pid=11051): Terminated {rc=256} 13:37:05.282967 --- ParallelTerminationStrategy: PID 11054 died... 13:37:05.301853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11054): Terminated: ok {rc=0} 13:37:05.345747 --- ParallelTerminationStrategy: PID 11057 died... 13:37:05.364468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11057): Terminated: ok {rc=0} 13:37:05.408138 --- ParallelTerminationStrategy: PID 11060 died... 13:37:05.426983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11060): Terminated: ok {rc=0} 13:37:05.512661 bus /gobi_4: Setting Powered False 13:37:06.613280 bus /gobi_4: Setting Powered False 13:37:07.726808 bus /gobi_1: Setting Powered False 13:37:08.825509 bus /gobi_1: Setting Powered False 13:37:09.942153 bus /gobi_0: Setting Powered False 13:37:11.040271 bus /gobi_0: Setting Powered False 13:37:12.160278 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:37:13.263901 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:37:13.275475 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:37:13.344299 tst ping.py: using LAC 21823 13:37:13.460295 tst ping.py: using RAC 148 13:37:13.576353 tst ping.py: using CellId 21823 13:37:13.701089 tst ping.py: using BVCI 21824 13:37:13.817567 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:37:13.829151 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:37:13.840466 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:37:13.852226 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:37:13.863843 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:37:13.875556 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:37:13.887226 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:37:13.898794 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:37:14.013240 tst ping.py:19: start network... 13:37:14.208730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:14.666655 run create_hlr_db(pid=11062): Launched 13:37:14.788185 bus /gobi_6: Setting Powered False 13:37:15.847911 run create_hlr_db(pid=11062): Terminated: ok {rc=0} 13:37:16.289736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11064): Launched 13:37:16.605376 run osmo-hlr_10.42.42.2(pid=11065): Launched 13:37:16.857779 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:17.479180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11067): Launched 13:37:17.774691 run osmo-stp_10.42.42.5(pid=11068): Launched 13:37:17.885749 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:37:18.394452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11070): Launched 13:37:18.506579 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:37:18.755776 run patchelf(pid=11071): Launched 13:37:18.920098 run osmo-stp_10.42.42.5(pid=11068): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11068)] 13:37:19.044700 run osmo-stp_10.42.42.5(pid=11068): stdout: | (launched: 2022-12-09_13:37:17.719990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:19.171166 run osmo-stp_10.42.42.5(pid=11068): stderr: | 20221209133717888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133717888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133717888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133717889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133717889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133717889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133717889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:19.297141 run osmo-stp_10.42.42.5(pid=11068): stdout: | (launched: 2022-12-09_13:37:17.719990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:19.417773 run osmo-stp_10.42.42.5(pid=11068): stderr: | 20221209133717888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133717888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133717888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133717889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133717889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133717889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133717889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:19.560861 run patchelf(pid=11071): Terminating (SIGINT) 13:37:19.725791 run patchelf(pid=11071): Terminated: ok {rc=0} 13:37:19.844055 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11068): Process ended prematurely: osmo-stp_10.42.42.5(pid=11068) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11068)] [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 13:37:19.852850 tst ping.py:22: Test FAILED (6.6 sec) 13:37:19.879567 run osmo-hlr_10.42.42.2(pid=11065): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11065)] 13:37:19.927072 run osmo-hlr_10.42.42.2(pid=11065): stdout: | (launched: 2022-12-09_13:37:16.547373) 13:37:19.976336 run osmo-hlr_10.42.42.2(pid=11065): stderr: | 20221209133716774 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133716774 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133716774 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133716774 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133716774 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133716774 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133716792 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133716822 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133716822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133716822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:20.026199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11064): Terminating (SIGTERM) 13:37:20.066523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11067): Terminating (SIGTERM) 13:37:20.106582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11070): Terminating (SIGTERM) 13:37:20.146770 --- ParallelTerminationStrategy: PID 11064 died... 13:37:20.165926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11064): Terminated: ok {rc=0} 13:37:20.209841 --- ParallelTerminationStrategy: PID 11067 died... 13:37:20.228521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11067): Terminated: ok {rc=0} 13:37:20.272658 --- ParallelTerminationStrategy: PID 11070 died... 13:37:20.291714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11070): Terminated: ok {rc=0} 13:37:20.377049 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:37:21.466439 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:37:21.478540 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:37:21.549384 tst ping_idle_ping.py: using LAC 21824 13:37:21.667435 tst ping_idle_ping.py: using RAC 149 13:37:21.786193 tst ping_idle_ping.py: using CellId 21824 13:37:21.904196 tst ping_idle_ping.py: using BVCI 21825 13:37:22.011161 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:37:22.022192 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:37:22.032708 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:37:22.043433 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:37:22.053956 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:37:22.064509 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:37:22.075332 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:37:22.085851 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:37:22.202443 tst ping_idle_ping.py:24: start network... 13:37:22.416062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:22.909804 run create_hlr_db(pid=11072): Launched 13:37:23.032604 bus /gobi_6: Setting Powered False 13:37:24.096031 run create_hlr_db(pid=11072): Terminated: ok {rc=0} 13:37:24.522219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11074): Launched 13:37:24.819099 run osmo-hlr_10.42.42.2(pid=11075): Launched 13:37:24.931269 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:25.439736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11077): Launched 13:37:25.735112 run osmo-stp_10.42.42.5(pid=11078): Launched 13:37:25.847785 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:37:26.356707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11080): Launched 13:37:26.469541 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:37:26.718839 run patchelf(pid=11081): Launched 13:37:26.883437 run osmo-stp_10.42.42.5(pid=11078): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11078)] 13:37:27.008899 run osmo-stp_10.42.42.5(pid=11078): stdout: | (launched: 2022-12-09_13:37:25.680421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:27.136587 run osmo-stp_10.42.42.5(pid=11078): stderr: | 20221209133725851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133725851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133725851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133725851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133725852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133725852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133725852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:27.263936 run osmo-stp_10.42.42.5(pid=11078): stdout: | (launched: 2022-12-09_13:37:25.680421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:27.385866 run osmo-stp_10.42.42.5(pid=11078): stderr: | 20221209133725851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133725851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133725851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133725851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133725852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133725852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133725852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:27.530161 run patchelf(pid=11081): Terminating (SIGINT) 13:37:27.696037 run patchelf(pid=11081): Terminated: ok {rc=0} 13:37:27.815699 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11078): Process ended prematurely: osmo-stp_10.42.42.5(pid=11078) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11078)] [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:37:27.824552 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:37:27.851343 run osmo-hlr_10.42.42.2(pid=11075): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11075)] 13:37:27.898970 run osmo-hlr_10.42.42.2(pid=11075): stdout: | (launched: 2022-12-09_13:37:24.764762) 13:37:27.948218 run osmo-hlr_10.42.42.2(pid=11075): stderr: | 20221209133724939 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133724939 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133724939 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133724939 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133724940 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133724940 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133724951 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133724960 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133724961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133724961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:27.998083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11074): Terminating (SIGTERM) 13:37:28.037839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11077): Terminating (SIGTERM) 13:37:28.077640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11080): Terminating (SIGTERM) 13:37:28.117791 --- ParallelTerminationStrategy: PID 11074 died... 13:37:28.137042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11074): Terminated: ok {rc=0} 13:37:28.181163 --- ParallelTerminationStrategy: PID 11077 died... 13:37:28.200008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11077): Terminated: ok {rc=0} 13:37:28.243904 --- ParallelTerminationStrategy: PID 11080 died... 13:37:28.262833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11080): Terminated: ok {rc=0} 13:37:28.346199 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:37:29.655498 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:37:29.662517 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:37:29.698100 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:37:29.738122 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:37:29.826417 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:37:29.860318 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:37:29.900256 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:37:30.494593 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:37:30.547305 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:30.558821 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:37:30.630382 tst cs_paging_gprs_active.py: using LAC 21825 13:37:30.757623 tst cs_paging_gprs_active.py: using RAC 150 13:37:30.877284 tst cs_paging_gprs_active.py: using CellId 21825 13:37:31.011564 tst cs_paging_gprs_active.py: using BVCI 21826 13:37:31.173530 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:31.190645 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:31.206882 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:31.221900 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:31.238686 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:31.255687 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:31.273433 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:31.290130 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:31.306952 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:37:31.434378 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:37:31.566273 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:37:31.790141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:37:32.125744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11085): Launched 13:37:32.433676 run iperf3-srv_10.42.42.10(pid=11086): Launched 13:37:32.556444 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:37:32.772885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:37:33.094056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11087): Launched 13:37:33.374124 run iperf3-srv_10.42.42.10(pid=11088): Launched 13:37:33.495733 tst cs_paging_gprs_active.py:38: start network... 13:37:33.712492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:34.210903 run create_hlr_db(pid=11089): Launched 13:37:34.334290 bus /gobi_6: Setting Powered False 13:37:35.397766 run create_hlr_db(pid=11089): Terminated: ok {rc=0} 13:37:35.831792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11091): Launched 13:37:36.153953 run osmo-hlr_10.42.42.2(pid=11094): Launched 13:37:36.277369 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:36.835221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11096): Launched 13:37:37.155859 run osmo-stp_10.42.42.5(pid=11097): Launched 13:37:37.278645 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:37:37.834657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11099): Launched 13:37:37.958878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:37:38.230289 run patchelf(pid=11100): Launched 13:37:38.411731 run osmo-stp_10.42.42.5(pid=11097): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11097)] 13:37:38.549189 run osmo-stp_10.42.42.5(pid=11097): stdout: | (launched: 2022-12-09_13:37:37.097351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:38.687199 run osmo-stp_10.42.42.5(pid=11097): stderr: | 20221209133737287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133737287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133737288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133737288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133737289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133737289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133737289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:38.825174 run osmo-stp_10.42.42.5(pid=11097): stdout: | (launched: 2022-12-09_13:37:37.097351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:38.957201 run osmo-stp_10.42.42.5(pid=11097): stderr: | 20221209133737287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133737287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133737288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133737288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133737289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133737289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133737289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:39.113965 run patchelf(pid=11100): Terminating (SIGINT) 13:37:39.293290 run patchelf(pid=11100): Terminated: ok {rc=0} 13:37:39.422735 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11097): Process ended prematurely: osmo-stp_10.42.42.5(pid=11097) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11097)] [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:37:39.432820 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:37:39.461815 run osmo-hlr_10.42.42.2(pid=11094): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11094)] 13:37:39.511787 run osmo-hlr_10.42.42.2(pid=11094): stdout: | (launched: 2022-12-09_13:37:36.095300) 13:37:39.563809 run osmo-hlr_10.42.42.2(pid=11094): stderr: | 20221209133736294 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133736294 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133736294 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133736295 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133736295 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133736295 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133736307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133736315 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133736315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133736315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:39.615938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11085): Terminating (SIGTERM) 13:37:39.658050 run iperf3-srv_10.42.42.10(pid=11086): Terminating (SIGTERM) 13:37:39.699498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11087): Terminating (SIGTERM) 13:37:39.741641 run iperf3-srv_10.42.42.10(pid=11088): Terminating (SIGTERM) 13:37:39.783488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11091): Terminating (SIGTERM) 13:37:39.825321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11096): Terminating (SIGTERM) 13:37:39.866936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11099): Terminating (SIGTERM) 13:37:39.909019 --- ParallelTerminationStrategy: PID 11085 died... 13:37:39.929007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11085): Terminated: ok {rc=0} 13:37:39.975477 --- ParallelTerminationStrategy: PID 11086 died... 13:37:39.995095 run iperf3-srv_10.42.42.10(pid=11086): Terminated {rc=256} 13:37:40.041534 --- ParallelTerminationStrategy: PID 11087 died... 13:37:40.061067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11087): Terminated: ok {rc=0} 13:37:40.107311 --- ParallelTerminationStrategy: PID 11088 died... 13:37:40.126851 run iperf3-srv_10.42.42.10(pid=11088): Terminated {rc=256} 13:37:40.173325 --- ParallelTerminationStrategy: PID 11091 died... 13:37:40.192794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11091): Terminated: ok {rc=0} 13:37:40.239202 --- ParallelTerminationStrategy: PID 11096 died... 13:37:40.258805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11096): Terminated: ok {rc=0} 13:37:40.305327 --- ParallelTerminationStrategy: PID 11099 died... 13:37:40.324863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11099): Terminated: ok {rc=0} 13:37:40.412236 bus /gobi_0: Setting Powered False 13:37:41.512436 bus /gobi_0: Setting Powered False 13:37:42.630967 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:37:43.776208 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:43.787835 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:37:43.858307 tst iperf3.py: using LAC 21826 13:37:43.978153 tst iperf3.py: using RAC 151 13:37:44.097699 tst iperf3.py: using CellId 21826 13:37:44.216687 tst iperf3.py: using BVCI 21827 13:37:44.328152 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:44.339499 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:44.350361 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:44.361237 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:44.371922 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:44.382538 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:44.393379 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:44.404013 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:44.414903 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:37:44.527358 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:37:44.729330 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:37:45.030995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11101): Launched 13:37:45.293016 run iperf3-srv_10.42.42.10(pid=11102): Launched 13:37:45.405725 tst iperf3.py:8: start network... 13:37:45.605467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:46.089718 run create_hlr_db(pid=11103): Launched 13:37:46.246387 bus /gobi_6: Setting Powered False 13:37:47.304075 run create_hlr_db(pid=11103): Terminated: ok {rc=0} 13:37:47.723576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11105): Launched 13:37:48.024458 run osmo-hlr_10.42.42.2(pid=11106): Launched 13:37:48.139201 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:48.668381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11108): Launched 13:37:48.969474 run osmo-stp_10.42.42.5(pid=11109): Launched 13:37:49.083812 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:37:49.602486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11111): Launched 13:37:49.718566 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:37:49.971563 run patchelf(pid=11112): Launched 13:37:50.137882 run osmo-stp_10.42.42.5(pid=11109): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11109)] 13:37:50.264682 run osmo-stp_10.42.42.5(pid=11109): stdout: | (launched: 2022-12-09_13:37:48.913550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:50.392905 run osmo-stp_10.42.42.5(pid=11109): stderr: | 20221209133749084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133749085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133749085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133749085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133749086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133749086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133749086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:50.521935 run osmo-stp_10.42.42.5(pid=11109): stdout: | (launched: 2022-12-09_13:37:48.913550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:50.644862 run osmo-stp_10.42.42.5(pid=11109): stderr: | 20221209133749084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133749085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133749085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133749085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133749086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133749086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133749086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:50.790470 run patchelf(pid=11112): Terminating (SIGINT) 13:37:50.957716 run patchelf(pid=11112): Terminated: ok {rc=0} 13:37:51.078279 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11109): Process ended prematurely: osmo-stp_10.42.42.5(pid=11109) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11109)] [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 13:37:51.088152 tst iperf3.py:8: Test FAILED (7.3 sec) 13:37:51.115365 run osmo-hlr_10.42.42.2(pid=11106): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11106)] 13:37:51.162479 run osmo-hlr_10.42.42.2(pid=11106): stdout: | (launched: 2022-12-09_13:37:47.969293) 13:37:51.211161 run osmo-hlr_10.42.42.2(pid=11106): stderr: | 20221209133748145 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133748145 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133748145 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133748145 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133748145 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133748145 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133748157 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133748166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133748167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133748167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:51.260410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11101): Terminating (SIGTERM) 13:37:51.299588 run iperf3-srv_10.42.42.10(pid=11102): Terminating (SIGTERM) 13:37:51.338912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11105): Terminating (SIGTERM) 13:37:51.378128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11108): Terminating (SIGTERM) 13:37:51.417383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11111): Terminating (SIGTERM) 13:37:51.457363 --- ParallelTerminationStrategy: PID 11101 died... 13:37:51.476181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11101): Terminated: ok {rc=0} 13:37:51.520173 --- ParallelTerminationStrategy: PID 11102 died... 13:37:51.539055 run iperf3-srv_10.42.42.10(pid=11102): Terminated {rc=256} 13:37:51.582707 --- ParallelTerminationStrategy: PID 11105 died... 13:37:51.601285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11105): Terminated: ok {rc=0} 13:37:51.645094 --- ParallelTerminationStrategy: PID 11108 died... 13:37:51.663740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11108): Terminated: ok {rc=0} 13:37:51.707142 --- ParallelTerminationStrategy: PID 11111 died... 13:37:51.726041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11111): Terminated: ok {rc=0} 13:37:51.808566 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:37:52.956883 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:52.969197 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:37:53.043246 tst iperf3m4.py: using LAC 21827 13:37:53.170552 tst iperf3m4.py: using RAC 152 13:37:53.298693 tst iperf3m4.py: using CellId 21827 13:37:53.426401 tst iperf3m4.py: using BVCI 21828 13:37:53.543869 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:53.555174 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:53.566340 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:53.578070 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:53.589837 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:53.601352 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:53.612684 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:53.623964 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:37:53.635546 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:37:53.752377 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:37:53.874844 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:37:53.990544 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:37:54.108618 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:37:54.325258 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:37:54.648755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11113): Launched 13:37:54.928649 run iperf3-srv_10.42.42.10(pid=11114): Launched 13:37:55.042414 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:37:55.243483 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:37:55.546841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11115): Launched 13:37:55.809726 run iperf3-srv_10.42.42.10(pid=11116): Launched 13:37:55.922825 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:37:56.123888 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:37:56.425534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11117): Launched 13:37:56.689219 run iperf3-srv_10.42.42.10(pid=11118): Launched 13:37:56.802103 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:37:57.002944 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:37:57.305435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11119): Launched 13:37:57.568612 run iperf3-srv_10.42.42.10(pid=11120): Launched 13:37:57.681256 tst iperf3m4.py:8: start network... 13:37:57.882061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:58.348885 run create_hlr_db(pid=11121): Launched 13:37:58.472520 bus /gobi_6: Setting Powered False 13:37:59.536931 run create_hlr_db(pid=11121): Terminated: ok {rc=0} 13:37:59.967732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11123): Launched 13:38:00.269725 run osmo-hlr_10.42.42.2(pid=11124): Launched 13:38:00.384301 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:00.933413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11126): Launched 13:38:01.258342 run osmo-stp_10.42.42.5(pid=11127): Launched 13:38:01.516860 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:38:02.257152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11157): Launched 13:38:02.422239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:38:02.713700 run patchelf(pid=11167): Launched 13:38:02.977190 run osmo-stp_10.42.42.5(pid=11127): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11127)] 13:38:03.124760 run osmo-stp_10.42.42.5(pid=11127): stdout: | (launched: 2022-12-09_13:38:01.201930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:03.282601 run osmo-stp_10.42.42.5(pid=11127): stderr: | 20221209133801485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133801485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133801485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133801486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133801486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133801486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133801486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:03.444789 run osmo-stp_10.42.42.5(pid=11127): stdout: | (launched: 2022-12-09_13:38:01.201930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:03.612291 run osmo-stp_10.42.42.5(pid=11127): stderr: | 20221209133801485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133801485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133801485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133801486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133801486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133801486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133801486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:03.810455 run patchelf(pid=11167): Terminating (SIGINT) 13:38:04.030145 run patchelf(pid=11167): Terminated: ok {rc=0} 13:38:04.190774 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11127): Process ended prematurely: osmo-stp_10.42.42.5(pid=11127) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11127)] [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:38:04.202515 tst iperf3m4.py:8: Test FAILED (11.3 sec) 13:38:04.244215 run osmo-hlr_10.42.42.2(pid=11124): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11124)] 13:38:04.309715 run osmo-hlr_10.42.42.2(pid=11124): stdout: | (launched: 2022-12-09_13:38:00.213983) 13:38:04.375349 run osmo-hlr_10.42.42.2(pid=11124): stderr: | 20221209133800390 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133800390 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133800390 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133800390 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133800390 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133800390 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133800402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133800411 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133800412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133800412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:04.443102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11113): Terminating (SIGTERM) 13:38:04.499599 run iperf3-srv_10.42.42.10(pid=11114): Terminating (SIGTERM) 13:38:04.558648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11115): Terminating (SIGTERM) 13:38:04.613651 run iperf3-srv_10.42.42.10(pid=11116): Terminating (SIGTERM) 13:38:04.674429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11117): Terminating (SIGTERM) 13:38:04.732614 run iperf3-srv_10.42.42.10(pid=11118): Terminating (SIGTERM) 13:38:04.790207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11119): Terminating (SIGTERM) 13:38:04.839973 run iperf3-srv_10.42.42.10(pid=11120): Terminating (SIGTERM) 13:38:04.896933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11123): Terminating (SIGTERM) 13:38:04.949827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11126): Terminating (SIGTERM) 13:38:05.009778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11157): Terminating (SIGTERM) 13:38:05.073618 --- ParallelTerminationStrategy: PID 11113 died... 13:38:05.098936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11113): Terminated: ok {rc=0} 13:38:05.150341 --- ParallelTerminationStrategy: PID 11114 died... 13:38:05.171044 run iperf3-srv_10.42.42.10(pid=11114): Terminated {rc=256} 13:38:05.220534 --- ParallelTerminationStrategy: PID 11115 died... 13:38:05.241520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11115): Terminated: ok {rc=0} 13:38:05.299861 --- ParallelTerminationStrategy: PID 11116 died... 13:38:05.321335 run iperf3-srv_10.42.42.10(pid=11116): Terminated {rc=256} 13:38:05.372298 --- ParallelTerminationStrategy: PID 11117 died... 13:38:05.393416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11117): Terminated: ok {rc=0} 13:38:05.445035 --- ParallelTerminationStrategy: PID 11118 died... 13:38:05.465755 run iperf3-srv_10.42.42.10(pid=11118): Terminated {rc=256} 13:38:05.515946 --- ParallelTerminationStrategy: PID 11119 died... 13:38:05.537905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11119): Terminated: ok {rc=0} 13:38:05.588033 --- ParallelTerminationStrategy: PID 11120 died... 13:38:05.608893 run iperf3-srv_10.42.42.10(pid=11120): Terminated {rc=256} 13:38:05.658772 --- ParallelTerminationStrategy: PID 11123 died... 13:38:05.680015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11123): Terminated: ok {rc=0} 13:38:05.731477 --- ParallelTerminationStrategy: PID 11126 died... 13:38:05.752214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11126): Terminated: ok {rc=0} 13:38:05.801948 --- ParallelTerminationStrategy: PID 11157 died... 13:38:05.823213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11157): Terminated: ok {rc=0} 13:38:05.915187 bus /gobi_4: Setting Powered False 13:38:07.019405 bus /gobi_4: Setting Powered False 13:38:08.141569 bus /gobi_1: Setting Powered False 13:38:09.248677 bus /gobi_1: Setting Powered False 13:38:10.365095 bus /gobi_0: Setting Powered False 13:38:11.465852 bus /gobi_0: Setting Powered False 13:38:12.586428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:38:13.690870 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:38:13.703696 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:38:13.787570 tst ping.py: using LAC 21828 13:38:13.916156 tst ping.py: using RAC 153 13:38:14.037342 tst ping.py: using CellId 21828 13:38:14.159617 tst ping.py: using BVCI 21829 13:38:14.272597 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:38:14.284721 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:38:14.296528 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:38:14.308521 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:38:14.320555 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:38:14.333357 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:38:14.345685 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:38:14.357752 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:38:14.473766 tst ping.py:19: start network... 13:38:14.677291 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:15.149533 run create_hlr_db(pid=11403): Launched 13:38:15.309525 bus /gobi_6: Setting Powered False 13:38:16.392422 run create_hlr_db(pid=11403): Terminated: ok {rc=0} 13:38:16.973814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11405): Launched 13:38:17.300670 run osmo-hlr_10.42.42.2(pid=11406): Launched 13:38:17.570694 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:18.258885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11408): Launched 13:38:18.582312 run osmo-stp_10.42.42.5(pid=11409): Launched 13:38:18.825686 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:38:19.454277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11411): Launched 13:38:19.589017 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:38:19.861988 run patchelf(pid=11412): Launched 13:38:20.053519 run osmo-stp_10.42.42.5(pid=11409): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11409)] 13:38:20.191889 run osmo-stp_10.42.42.5(pid=11409): stdout: | (launched: 2022-12-09_13:38:18.519626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:20.331754 run osmo-stp_10.42.42.5(pid=11409): stderr: | 20221209133818804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133818804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133818804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133818805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133818805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133818805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133818805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:20.472403 run osmo-stp_10.42.42.5(pid=11409): stdout: | (launched: 2022-12-09_13:38:18.519626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:20.607239 run osmo-stp_10.42.42.5(pid=11409): stderr: | 20221209133818804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133818804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133818804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133818805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133818805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133818805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133818805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:20.765784 run patchelf(pid=11412): Terminating (SIGINT) 13:38:20.948099 run patchelf(pid=11412): Terminated: ok {rc=0} 13:38:21.079926 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11409): Process ended prematurely: osmo-stp_10.42.42.5(pid=11409) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11409)] [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 13:38:21.090651 tst ping.py:22: Test FAILED (7.4 sec) 13:38:21.122880 run osmo-hlr_10.42.42.2(pid=11406): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11406)] 13:38:21.176050 run osmo-hlr_10.42.42.2(pid=11406): stdout: | (launched: 2022-12-09_13:38:17.239040) 13:38:21.231168 run osmo-hlr_10.42.42.2(pid=11406): stderr: | 20221209133817583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133817583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133817583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133817583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133817583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133817583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133817603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133817616 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133817616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133817616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:21.286964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11405): Terminating (SIGTERM) 13:38:21.332598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11408): Terminating (SIGTERM) 13:38:21.379543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11411): Terminating (SIGTERM) 13:38:21.426690 --- ParallelTerminationStrategy: PID 11405 died... 13:38:21.448234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11405): Terminated: ok {rc=0} 13:38:21.500063 --- ParallelTerminationStrategy: PID 11408 died... 13:38:21.521178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11408): Terminated: ok {rc=0} 13:38:21.571559 --- ParallelTerminationStrategy: PID 11411 died... 13:38:21.592800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11411): Terminated: ok {rc=0} 13:38:21.686282 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:38:22.779077 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:38:22.792039 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:38:22.869825 tst ping_idle_ping.py: using LAC 21829 13:38:22.998506 tst ping_idle_ping.py: using RAC 154 13:38:23.129607 tst ping_idle_ping.py: using CellId 21829 13:38:23.257341 tst ping_idle_ping.py: using BVCI 21830 13:38:23.379515 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:38:23.391939 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:38:23.405727 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:38:23.419371 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:38:23.431869 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:38:23.445260 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:38:23.460012 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:38:23.473921 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:38:23.600101 tst ping_idle_ping.py:24: start network... 13:38:23.820515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:24.333678 run create_hlr_db(pid=11413): Launched 13:38:24.498444 bus /gobi_6: Setting Powered False 13:38:25.562482 run create_hlr_db(pid=11413): Terminated: ok {rc=0} 13:38:26.010134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11415): Launched 13:38:26.328686 run osmo-hlr_10.42.42.2(pid=11416): Launched 13:38:26.451058 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:27.000516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11418): Launched 13:38:27.316452 run osmo-stp_10.42.42.5(pid=11419): Launched 13:38:27.438987 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:38:27.987073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11421): Launched 13:38:28.109698 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:38:28.377580 run patchelf(pid=11422): Launched 13:38:28.555658 run osmo-stp_10.42.42.5(pid=11419): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11419)] 13:38:28.690621 run osmo-stp_10.42.42.5(pid=11419): stdout: | (launched: 2022-12-09_13:38:27.258533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:28.827098 run osmo-stp_10.42.42.5(pid=11419): stderr: | 20221209133827450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133827450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133827450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133827451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133827451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133827451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133827451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:28.963502 run osmo-stp_10.42.42.5(pid=11419): stdout: | (launched: 2022-12-09_13:38:27.258533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:29.093415 run osmo-stp_10.42.42.5(pid=11419): stderr: | 20221209133827450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133827450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133827450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133827451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133827451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133827451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133827451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:29.247115 run patchelf(pid=11422): Terminating (SIGINT) 13:38:29.424254 run patchelf(pid=11422): Terminated: ok {rc=0} 13:38:29.552499 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11419): Process ended prematurely: osmo-stp_10.42.42.5(pid=11419) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11419)] [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:38:29.562449 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 13:38:29.591529 run osmo-hlr_10.42.42.2(pid=11416): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11416)] 13:38:29.642496 run osmo-hlr_10.42.42.2(pid=11416): stdout: | (launched: 2022-12-09_13:38:26.270502) 13:38:29.695256 run osmo-hlr_10.42.42.2(pid=11416): stderr: | 20221209133826469 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133826469 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133826469 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133826469 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133826469 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133826469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133826485 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133826495 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133826495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133826495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:29.748506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11415): Terminating (SIGTERM) 13:38:29.791252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11418): Terminating (SIGTERM) 13:38:29.833789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11421): Terminating (SIGTERM) 13:38:29.876600 --- ParallelTerminationStrategy: PID 11415 died... 13:38:29.896936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11415): Terminated: ok {rc=0} 13:38:29.944369 --- ParallelTerminationStrategy: PID 11418 died... 13:38:29.964180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11418): Terminated: ok {rc=0} 13:38:30.011061 --- ParallelTerminationStrategy: PID 11421 died... 13:38:30.031064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11421): Terminated: ok {rc=0} 13:38:30.120309 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:38:31.432439 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:38:31.441696 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:38:31.477979 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:38:31.514305 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:38:31.568642 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:38:31.610419 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:38:31.653901 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:38:32.210045 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2360 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:38:32.215954 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:38:32.228323 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:38:32.301361 tst switch_tch_pdch.py: using LAC 21830 13:38:32.428048 tst switch_tch_pdch.py: using RAC 155 13:38:32.552386 tst switch_tch_pdch.py: using CellId 21830 13:38:32.676184 tst switch_tch_pdch.py: using BVCI 21831 13:38:32.790854 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:38:32.802670 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:38:32.814423 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:38:32.826200 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:38:32.837868 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:38:32.849571 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:38:32.861463 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:38:32.873220 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:38:32.991124 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:38:33.113675 tst switch_tch_pdch.py:51: start network... 13:38:33.312429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:33.770010 run create_hlr_db(pid=11426): Launched 13:38:33.893485 bus /gobi_6: Setting Powered False 13:38:34.952659 run create_hlr_db(pid=11426): Terminated: ok {rc=0} 13:38:35.384124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11428): Launched 13:38:35.700514 run osmo-hlr_10.42.42.2(pid=11429): Launched 13:38:35.822353 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:36.370794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11431): Launched 13:38:36.687335 run osmo-stp_10.42.42.5(pid=11432): Launched 13:38:36.807200 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:38:37.350857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11434): Launched 13:38:37.473704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:38:37.740708 run patchelf(pid=11435): Launched 13:38:37.917570 run osmo-stp_10.42.42.5(pid=11432): ERR: Terminated: ERROR {rc=1} [trial-2360↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11432)] 13:38:38.051768 run osmo-stp_10.42.42.5(pid=11432): stdout: | (launched: 2022-12-09_13:38:36.629090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:38.187641 run osmo-stp_10.42.42.5(pid=11432): stderr: | 20221209133836820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133836820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133836820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133836821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133836821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133836821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133836821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:38.323441 run osmo-stp_10.42.42.5(pid=11432): stdout: | (launched: 2022-12-09_13:38:36.629090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:38.453379 run osmo-stp_10.42.42.5(pid=11432): stderr: | 20221209133836820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133836820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133836820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133836821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133836821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133836821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133836821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:38.607364 run patchelf(pid=11435): Terminating (SIGINT) 13:38:38.784062 run patchelf(pid=11435): Terminated: ok {rc=0} 13:38:38.911598 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11432): Process ended prematurely: osmo-stp_10.42.42.5(pid=11432) [trial-2360↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11432)] [trial-2360↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:38:38.921285 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 13:38:38.949939 run osmo-hlr_10.42.42.2(pid=11429): ERR: Terminated: ERROR {rc=237} [trial-2360↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11429)] 13:38:39.000097 run osmo-hlr_10.42.42.2(pid=11429): stdout: | (launched: 2022-12-09_13:38:35.642863) 13:38:39.052189 run osmo-hlr_10.42.42.2(pid=11429): stderr: | 20221209133835841 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133835841 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133835841 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133835841 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133835841 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133835841 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133835853 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133835861 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133835862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133835862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:39.104714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11428): Terminating (SIGTERM) 13:38:39.146721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11431): Terminating (SIGTERM) 13:38:39.188873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11434): Terminating (SIGTERM) 13:38:39.230901 --- ParallelTerminationStrategy: PID 11428 died... 13:38:39.251010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11428): Terminated: ok {rc=0} 13:38:39.297623 --- ParallelTerminationStrategy: PID 11431 died... 13:38:39.317331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11431): Terminated: ok {rc=0} 13:38:39.363707 --- ParallelTerminationStrategy: PID 11434 died... 13:38:39.383371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11434): Terminated: ok {rc=0} 13:38:39.470042 bus /gobi_0: Setting Powered False 13:38:40.568761 bus /gobi_0: Setting Powered False 13:38:41.683977 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:38:42.943585 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:38:42.950030 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:38:42.985179 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:38:43.020775 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:38:43.073758 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:38:43.108236 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:38:43.143858 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:38:43.700279 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2360 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:38:43.705881 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:38:43.717336 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:38:43.786951 tst switch_tch_pdch.py: using LAC 21831 13:38:43.909927 tst switch_tch_pdch.py: using RAC 156 13:38:44.036191 tst switch_tch_pdch.py: using CellId 21831 13:38:44.159558 tst switch_tch_pdch.py: using BVCI 21832 13:38:44.275345 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:38:44.286738 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:38:44.298061 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:38:44.309539 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:38:44.321016 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:38:44.332607 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:38:44.344370 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:38:44.355927 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:38:44.475486 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:38:44.592856 tst switch_tch_pdch.py:51: start network... 13:38:44.792200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:45.226507 run create_hlr_db(pid=11440): Launched 13:38:45.347671 bus /gobi_6: Setting Powered False 13:38:46.411674 run create_hlr_db(pid=11440): Terminated: ok {rc=0} 13:38:46.836558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11442): Launched 13:38:47.169331 run osmo-hlr_10.42.42.2(pid=11443): Launched 13:38:47.300670 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:47.783185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11445): Launched 13:38:48.077669 run osmo-stp_10.42.42.5(pid=11446): Launched 13:38:48.189018 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:38:48.672066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11448): Launched 13:38:48.784364 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:38:49.034151 run patchelf(pid=11449): Launched 13:38:49.199796 run osmo-stp_10.42.42.5(pid=11446): ERR: Terminated: ERROR {rc=1} [trial-2360↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11446)] 13:38:49.324740 run osmo-stp_10.42.42.5(pid=11446): stdout: | (launched: 2022-12-09_13:38:48.023335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:49.451462 run osmo-stp_10.42.42.5(pid=11446): stderr: | 20221209133848194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133848194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133848195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133848195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133848196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133848196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133848196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:49.577653 run osmo-stp_10.42.42.5(pid=11446): stdout: | (launched: 2022-12-09_13:38:48.023335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:49.698595 run osmo-stp_10.42.42.5(pid=11446): stderr: | 20221209133848194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133848194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133848195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133848195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133848196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133848196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133848196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:49.841930 run patchelf(pid=11449): Terminating (SIGINT) 13:38:50.007494 run patchelf(pid=11449): Terminated: ok {rc=0} 13:38:50.127435 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11446): Process ended prematurely: osmo-stp_10.42.42.5(pid=11446) [trial-2360↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11446)] [trial-2360↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:38:50.136294 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 13:38:50.162753 run osmo-hlr_10.42.42.2(pid=11443): ERR: Terminated: ERROR {rc=237} [trial-2360↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11443)] 13:38:50.210219 run osmo-hlr_10.42.42.2(pid=11443): stdout: | (launched: 2022-12-09_13:38:47.111087) 13:38:50.258999 run osmo-hlr_10.42.42.2(pid=11443): stderr: | 20221209133847341 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133847341 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133847341 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133847341 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133847341 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133847341 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133847353 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133847362 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133847362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133847362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:50.308746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11442): Terminating (SIGTERM) 13:38:50.348144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11445): Terminating (SIGTERM) 13:38:50.387623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11448): Terminating (SIGTERM) 13:38:50.427465 --- ParallelTerminationStrategy: PID 11442 died... 13:38:50.446587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11442): Terminated: ok {rc=0} 13:38:50.490316 --- ParallelTerminationStrategy: PID 11445 died... 13:38:50.508913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11445): Terminated: ok {rc=0} 13:38:50.552413 --- ParallelTerminationStrategy: PID 11448 died... 13:38:50.571081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11448): Terminated: ok {rc=0} 13:38:50.655739 bus /gobi_0: Setting Powered False 13:38:51.755071 bus /gobi_0: Setting Powered False 13:38:52.870751 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 13:38:54.119517 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:38:54.123503 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:38:54.152353 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 13:38:54.159629 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 13:38:54.210823 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:38:54.239766 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 13:38:54.246388 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 13:38:54.784700 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 13:38:54.789658 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 13:38:54.800412 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:38:54.843692 tst mo_mt_sms.py: using LAC 21832 13:38:54.959896 tst mo_mt_sms.py: using RAC 157 13:38:55.086740 tst mo_mt_sms.py: using CellId 21832 13:38:55.210218 tst mo_mt_sms.py: using BVCI 21833 13:38:55.324781 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:38:55.440471 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:38:55.552745 tst mo_mt_sms.py:9: start nitb and bts... 13:38:55.750415 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:38:56.349806 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11454): Launched 13:38:56.644498 run osmo-nitb_10.42.42.2(pid=11455): Launched 13:38:56.807551 run osmo-nitb_10.42.42.2(pid=11455): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11455)] 13:38:56.939927 run osmo-nitb_10.42.42.2(pid=11455): stdout: | (launched: 2022-12-09_13:38:56.590370) 13:38:57.074566 run osmo-nitb_10.42.42.2(pid=11455): stderr: | (launched: 2022-12-09_13:38:56.634195) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:38:57.208602 run osmo-nitb_10.42.42.2(pid=11455): stdout: | (launched: 2022-12-09_13:38:56.590370) 13:38:57.336627 run osmo-nitb_10.42.42.2(pid=11455): stderr: | (launched: 2022-12-09_13:38:56.634195) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11455): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11455) [trial-2360↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11455)] 13:38:57.754961 tst osmo-nitb_10.42.42.2(pid=11455): stdout: | (launched: 2022-12-09_13:38:56.590370) 13:38:57.874178 tst osmo-nitb_10.42.42.2(pid=11455): stderr: | (launched: 2022-12-09_13:38:56.634195) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:38:58.014166 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=11455): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11455) [trial-2360↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11455)] [trial-2360↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 13:38:58.022612 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 13:38:58.029391 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11454): Terminating (SIGTERM) 13:38:58.238249 --- ParallelTerminationStrategy: PID 11454 died... 13:38:58.259156 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11454): Terminated: ok {rc=0} 13:38:58.345048 bus /sierra_3: Setting Powered False 13:38:59.444534 bus /sierra_3: Setting Powered False 13:39:00.558488 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 13:39:01.757950 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:39:01.762210 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:39:01.792588 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 13:39:01.820453 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 13:39:01.871553 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:39:01.903074 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 13:39:01.932371 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 13:39:02.478967 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 13:39:02.484464 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:39:02.495819 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:39:02.541361 tst mo_mt_sms.py: using LAC 21833 13:39:02.666917 tst mo_mt_sms.py: using RAC 158 13:39:02.793334 tst mo_mt_sms.py: using CellId 21833 13:39:02.916688 tst mo_mt_sms.py: using BVCI 21834 13:39:03.031240 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:39:03.042389 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:39:03.053482 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:39:03.064798 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:39:03.076276 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:39:03.087674 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:39:03.201273 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:39:03.320176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:03.808822 run create_hlr_db(pid=11459): Launched 13:39:03.929953 bus /sierra_2: Setting Powered False 13:39:04.992105 run create_hlr_db(pid=11459): Terminated: ok {rc=0} 13:39:05.415125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11461): Launched 13:39:05.708816 run osmo-hlr_10.42.42.2(pid=11462): Launched 13:39:05.820630 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:06.326701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11464): Launched 13:39:06.622100 run osmo-stp_10.42.42.5(pid=11465): Launched 13:39:06.733631 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:07.270640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11467): Launched 13:39:07.566331 run osmo-msc_10.42.42.6(pid=11468): Launched 13:39:07.732654 run osmo-stp_10.42.42.5(pid=11465): ERR: Terminated: ERROR {rc=1} [trial-2360↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11465)] 13:39:07.857637 run osmo-stp_10.42.42.5(pid=11465): stdout: | (launched: 2022-12-09_13:39:06.567747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:07.983501 run osmo-stp_10.42.42.5(pid=11465): stderr: | 20221209133906738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133906738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133906739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133906739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133906739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133906740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133906740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:08.106620 run osmo-stp_10.42.42.5(pid=11465): stdout: | (launched: 2022-12-09_13:39:06.567747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:08.223536 run osmo-stp_10.42.42.5(pid=11465): stderr: | 20221209133906738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133906738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133906739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133906739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133906739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133906740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133906740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:08.363569 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=11465): Process ended prematurely: osmo-stp_10.42.42.5(pid=11465) [trial-2360↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11465)] [trial-2360↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 13:39:08.372405 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 13:39:08.398454 run osmo-hlr_10.42.42.2(pid=11462): ERR: Terminated: ERROR {rc=237} [trial-2360↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11462)] 13:39:08.445671 run osmo-hlr_10.42.42.2(pid=11462): stdout: | (launched: 2022-12-09_13:39:05.654424) 13:39:08.494565 run osmo-hlr_10.42.42.2(pid=11462): stderr: | 20221209133905829 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133905829 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133905829 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133905829 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133905829 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133905829 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133905842 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133905852 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133905853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133905853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:08.562989 run osmo-msc_10.42.42.6(pid=11468): ERR: Terminated: ERROR {rc=2} [trial-2360↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11468)] 13:39:08.610414 run osmo-msc_10.42.42.6(pid=11468): stdout: | (launched: 2022-12-09_13:39:07.511892) 13:39:08.659235 run osmo-msc_10.42.42.6(pid=11468): stderr: | 20221209133907780 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133907780 DLGLOBAL DEBUG validating counter group 0x7f6af37f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133907780 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133907781 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133907782 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133907782 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133907784 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133907784 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133907784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133907784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:39:08.709033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11461): Terminating (SIGTERM) 13:39:08.748317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11464): Terminating (SIGTERM) 13:39:08.787712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11467): Terminating (SIGTERM) 13:39:08.827319 --- ParallelTerminationStrategy: PID 11461 died... 13:39:08.846400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11461): Terminated: ok {rc=0} 13:39:08.890104 --- ParallelTerminationStrategy: PID 11464 died... 13:39:08.908560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11464): Terminated: ok {rc=0} 13:39:08.952251 --- ParallelTerminationStrategy: PID 11467 died... 13:39:08.970953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11467): Terminated: ok {rc=0} 13:39:09.056058 bus /sierra_3: Setting Powered False 13:39:10.157624 bus /sierra_3: Setting Powered False 13:39:11.273291 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 13:39:12.503143 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:39:12.507329 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:39:12.537722 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 13:39:12.545219 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 13:39:12.581259 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:39:12.611390 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 13:39:12.618311 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 13:39:13.139495 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2360 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 13:39:13.145463 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 13:39:13.157254 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:39:13.202396 tst assert_extension.py: using LAC 21834 13:39:13.327488 tst assert_extension.py: using RAC 159 13:39:13.450654 tst assert_extension.py: using CellId 21834 13:39:13.570647 tst assert_extension.py: using BVCI 21835 13:39:13.678030 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 13:39:13.793066 tst assert_extension.py:10: start nitb and bts... 13:39:14.004893 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:39:14.648752 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11473): Launched 13:39:14.965338 run osmo-nitb_10.42.42.2(pid=11474): Launched 13:39:15.141347 run osmo-nitb_10.42.42.2(pid=11474): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11474)] 13:39:15.283708 run osmo-nitb_10.42.42.2(pid=11474): stdout: | (launched: 2022-12-09_13:39:14.907716) 13:39:15.427214 run osmo-nitb_10.42.42.2(pid=11474): stderr: | (launched: 2022-12-09_13:39:14.954592) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:39:15.571132 run osmo-nitb_10.42.42.2(pid=11474): stdout: | (launched: 2022-12-09_13:39:14.907716) 13:39:15.709280 run osmo-nitb_10.42.42.2(pid=11474): stderr: | (launched: 2022-12-09_13:39:14.954592) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11474): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11474) [trial-2360↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11474)] 13:39:16.085223 tst osmo-nitb_10.42.42.2(pid=11474): stdout: | (launched: 2022-12-09_13:39:14.907716) 13:39:16.211014 tst osmo-nitb_10.42.42.2(pid=11474): stderr: | (launched: 2022-12-09_13:39:14.954592) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:39:16.362371 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=11474): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11474) [trial-2360↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11474)] [trial-2360↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 13:39:16.371677 tst assert_extension.py:12: Test FAILED (3.2 sec) 13:39:16.378858 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11473): Terminating (SIGTERM) 13:39:16.590932 --- ParallelTerminationStrategy: PID 11473 died... 13:39:16.610592 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11473): Terminated: ok {rc=0} 13:39:16.697492 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 13:39:17.872684 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:39:17.877473 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:39:17.908189 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 13:39:17.934482 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 13:39:17.968477 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:39:17.997875 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 13:39:18.024738 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 13:39:18.554884 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2360 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 13:39:18.559973 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:39:18.570688 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:39:18.615305 tst assert_extension.py: using LAC 21835 13:39:18.732328 tst assert_extension.py: using RAC 160 13:39:18.855612 tst assert_extension.py: using CellId 21835 13:39:18.978332 tst assert_extension.py: using BVCI 21836 13:39:19.092642 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:39:19.104029 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:39:19.115119 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:39:19.126522 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:39:19.137904 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:39:19.149179 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 13:39:19.265155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:19.723209 run create_hlr_db(pid=11479): Launched 13:39:19.843984 bus /sierra_2: Setting Powered False 13:39:20.903833 run create_hlr_db(pid=11479): Terminated: ok {rc=0} 13:39:21.338327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11481): Launched 13:39:21.656773 run osmo-hlr_10.42.42.2(pid=11482): Launched 13:39:21.778859 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:22.328539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11484): Launched 13:39:22.645805 run osmo-stp_10.42.42.5(pid=11485): Launched 13:39:22.766340 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:23.336606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11487): Launched 13:39:23.652185 run osmo-msc_10.42.42.6(pid=11488): Launched 13:39:23.828535 run osmo-stp_10.42.42.5(pid=11485): ERR: Terminated: ERROR {rc=1} [trial-2360↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11485)] 13:39:23.963152 run osmo-stp_10.42.42.5(pid=11485): stdout: | (launched: 2022-12-09_13:39:22.587353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:24.098394 run osmo-stp_10.42.42.5(pid=11485): stderr: | 20221209133922780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133922780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133922780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133922781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133922781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133922781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133922781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:24.231862 run osmo-stp_10.42.42.5(pid=11485): stdout: | (launched: 2022-12-09_13:39:22.587353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:24.358116 run osmo-stp_10.42.42.5(pid=11485): stderr: | 20221209133922780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133922780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133922780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133922781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133922781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133922781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133922781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:24.508404 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=11485): Process ended prematurely: osmo-stp_10.42.42.5(pid=11485) [trial-2360↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11485)] [trial-2360↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 13:39:24.517528 tst assert_extension.py:17: Test FAILED (6.0 sec) 13:39:24.545675 run osmo-hlr_10.42.42.2(pid=11482): ERR: Terminated: ERROR {rc=237} [trial-2360↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11482)] 13:39:24.596312 run osmo-hlr_10.42.42.2(pid=11482): stdout: | (launched: 2022-12-09_13:39:21.598808) 13:39:24.648324 run osmo-hlr_10.42.42.2(pid=11482): stderr: | 20221209133921797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133921797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133921797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133921797 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133921797 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133921797 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133921810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133921820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133921820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133921820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:24.721218 run osmo-msc_10.42.42.6(pid=11488): ERR: Terminated: ERROR {rc=2} [trial-2360↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11488)] 13:39:24.771623 run osmo-msc_10.42.42.6(pid=11488): stdout: | (launched: 2022-12-09_13:39:23.594448) 13:39:24.823527 run osmo-msc_10.42.42.6(pid=11488): stderr: | 20221209133923914 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133923914 DLGLOBAL DEBUG validating counter group 0x7f20598d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133923914 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133923914 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133923914 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133923914 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133923916 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133923916 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133923917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133923917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:39:24.875913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11481): Terminating (SIGTERM) 13:39:24.917744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11484): Terminating (SIGTERM) 13:39:24.959657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11487): Terminating (SIGTERM) 13:39:25.001842 --- ParallelTerminationStrategy: PID 11481 died... 13:39:25.021991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11481): Terminated: ok {rc=0} 13:39:25.068503 --- ParallelTerminationStrategy: PID 11484 died... 13:39:25.088129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11484): Terminated: ok {rc=0} 13:39:25.134808 --- ParallelTerminationStrategy: PID 11487 died... 13:39:25.154380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11487): Terminated: ok {rc=0} 13:39:25.241605 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:39:26.450667 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:39:26.457879 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:39:26.488472 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:39:26.516333 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:39:26.571797 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:39:26.602524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:39:26.629032 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:39:27.182940 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:39:27.236268 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:39:27.248172 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:39:27.315602 tst mo_mt_call.py: using LAC 21836 13:39:27.442234 tst mo_mt_call.py: using RAC 161 13:39:27.570476 tst mo_mt_call.py: using CellId 21836 13:39:27.698132 tst mo_mt_call.py: using BVCI 21837 13:39:27.815275 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:39:27.827132 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:39:27.838736 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:39:27.850570 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:39:27.862537 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:39:27.874269 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:39:27.989652 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:39:28.107890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:28.608253 run create_hlr_db(pid=11493): Launched 13:39:28.730730 bus /sierra_2: Setting Powered False 13:39:29.793874 run create_hlr_db(pid=11493): Terminated: ok {rc=0} 13:39:30.223106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11495): Launched 13:39:30.523749 run osmo-hlr_10.42.42.2(pid=11496): Launched 13:39:30.639607 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:31.213806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11498): Launched 13:39:31.529450 run osmo-stp_10.42.42.5(pid=11499): Launched 13:39:31.767007 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:32.477506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11501): Launched 13:39:32.778494 run osmo-msc_10.42.42.6(pid=11502): Launched 13:39:32.948847 run osmo-stp_10.42.42.5(pid=11499): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11499)] 13:39:33.075906 run osmo-stp_10.42.42.5(pid=11499): stdout: | (launched: 2022-12-09_13:39:31.468672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:33.202805 run osmo-stp_10.42.42.5(pid=11499): stderr: | 20221209133931806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133931806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133931807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133931807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133931807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133931807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133931807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:33.328248 run osmo-stp_10.42.42.5(pid=11499): stdout: | (launched: 2022-12-09_13:39:31.468672) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:33.448111 run osmo-stp_10.42.42.5(pid=11499): stderr: | 20221209133931806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133931806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133931807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133931807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133931807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133931807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133931807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:33.591597 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11499): Process ended prematurely: osmo-stp_10.42.42.5(pid=11499) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11499)] [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:39:33.600616 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:39:33.627164 run osmo-hlr_10.42.42.2(pid=11496): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11496)] 13:39:33.674373 run osmo-hlr_10.42.42.2(pid=11496): stdout: | (launched: 2022-12-09_13:39:30.468536) 13:39:33.723455 run osmo-hlr_10.42.42.2(pid=11496): stderr: | 20221209133930646 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133930646 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133930646 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133930646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133930646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133930647 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133930661 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133930672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133930672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133930672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:33.791946 run osmo-msc_10.42.42.6(pid=11502): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11502)] 13:39:33.839338 run osmo-msc_10.42.42.6(pid=11502): stdout: | (launched: 2022-12-09_13:39:32.722970) 13:39:33.888604 run osmo-msc_10.42.42.6(pid=11502): stderr: | 20221209133932993 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133932993 DLGLOBAL DEBUG validating counter group 0x7feec2364c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133932994 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133932994 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133932994 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133932994 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133932996 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133932996 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133932996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133932996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:39:33.937762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11495): Terminating (SIGTERM) 13:39:33.977173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11498): Terminating (SIGTERM) 13:39:34.016613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11501): Terminating (SIGTERM) 13:39:34.056409 --- ParallelTerminationStrategy: PID 11495 died... 13:39:34.075650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11495): Terminated: ok {rc=0} 13:39:34.119547 --- ParallelTerminationStrategy: PID 11498 died... 13:39:34.138358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11498): Terminated: ok {rc=0} 13:39:34.182138 --- ParallelTerminationStrategy: PID 11501 died... 13:39:34.200883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11501): Terminated: ok {rc=0} 13:39:34.284105 bus /sierra_3: Setting Powered False 13:39:35.381284 bus /sierra_3: Setting Powered False 13:39:36.495828 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:39:37.642761 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:39:37.654575 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:39:37.720912 tst mo_mt_call_osmux.py: using LAC 21837 13:39:37.841467 tst mo_mt_call_osmux.py: using RAC 162 13:39:37.970345 tst mo_mt_call_osmux.py: using CellId 21837 13:39:38.098094 tst mo_mt_call_osmux.py: using BVCI 21838 13:39:38.215247 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:39:38.227271 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:39:38.238992 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:39:38.250954 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:39:38.262773 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:39:38.274522 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:39:38.389856 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:39:38.504570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:38.973198 run create_hlr_db(pid=11504): Launched 13:39:39.096785 bus /sierra_2: Setting Powered False 13:39:40.157778 run create_hlr_db(pid=11504): Terminated: ok {rc=0} 13:39:40.597712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11506): Launched 13:39:40.919924 run osmo-hlr_10.42.42.2(pid=11507): Launched 13:39:41.042783 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:41.595931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11509): Launched 13:39:41.917710 run osmo-stp_10.42.42.5(pid=11510): Launched 13:39:42.042116 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:42.629111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11512): Launched 13:39:42.950937 run osmo-msc_10.42.42.6(pid=11513): Launched 13:39:43.132122 run osmo-stp_10.42.42.5(pid=11510): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11510)] 13:39:43.268580 run osmo-stp_10.42.42.5(pid=11510): stdout: | (launched: 2022-12-09_13:39:41.858673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:43.405055 run osmo-stp_10.42.42.5(pid=11510): stderr: | 20221209133942052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133942052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133942052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133942053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133942053 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133942053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133942053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:43.540661 run osmo-stp_10.42.42.5(pid=11510): stdout: | (launched: 2022-12-09_13:39:41.858673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:43.669645 run osmo-stp_10.42.42.5(pid=11510): stderr: | 20221209133942052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133942052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133942052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133942053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133942053 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133942053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133942053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:43.823317 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11510): Process ended prematurely: osmo-stp_10.42.42.5(pid=11510) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11510)] [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:39:43.832780 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:39:43.861388 run osmo-hlr_10.42.42.2(pid=11507): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11507)] 13:39:43.911614 run osmo-hlr_10.42.42.2(pid=11507): stdout: | (launched: 2022-12-09_13:39:40.861098) 13:39:43.963654 run osmo-hlr_10.42.42.2(pid=11507): stderr: | 20221209133941059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133941059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133941060 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133941060 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133941060 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133941060 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133941072 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133941080 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133941080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133941081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:44.036062 run osmo-msc_10.42.42.6(pid=11513): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11513)] 13:39:44.086135 run osmo-msc_10.42.42.6(pid=11513): stdout: | (launched: 2022-12-09_13:39:42.892055) 13:39:44.138064 run osmo-msc_10.42.42.6(pid=11513): stderr: | 20221209133943213 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133943213 DLGLOBAL DEBUG validating counter group 0x7fc4c0af9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133943214 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133943214 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133943214 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133943214 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133943216 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133943216 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133943216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133943216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:39:44.190160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11506): Terminating (SIGTERM) 13:39:44.231970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11509): Terminating (SIGTERM) 13:39:44.273917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11512): Terminating (SIGTERM) 13:39:44.316317 --- ParallelTerminationStrategy: PID 11506 died... 13:39:44.336532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11506): Terminated: ok {rc=0} 13:39:44.383041 --- ParallelTerminationStrategy: PID 11509 died... 13:39:44.402656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11509): Terminated: ok {rc=0} 13:39:44.449172 --- ParallelTerminationStrategy: PID 11512 died... 13:39:44.468680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11512): Terminated: ok {rc=0} 13:39:44.556363 bus /sierra_3: Setting Powered False 13:39:45.654477 bus /sierra_3: Setting Powered False 13:39:46.774236 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:39:48.027769 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:39:48.035272 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:39:48.066223 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:39:48.093794 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:39:48.147402 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:39:48.177922 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:39:48.204614 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:39:48.757412 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:39:48.810079 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:48.821932 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:39:48.893310 tst mo_mt_call.py: using LAC 21838 13:39:49.018974 tst mo_mt_call.py: using RAC 163 13:39:49.145256 tst mo_mt_call.py: using CellId 21838 13:39:49.271384 tst mo_mt_call.py: using BVCI 21839 13:39:49.388284 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:49.400140 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:49.411645 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:49.423459 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:49.435233 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:49.447103 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:39:49.567921 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:39:49.689185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:50.188609 run create_hlr_db(pid=11518): Launched 13:39:50.311246 bus /sierra_2: Setting Powered False 13:39:51.375112 run create_hlr_db(pid=11518): Terminated: ok {rc=0} 13:39:51.804941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11520): Launched 13:39:52.107015 run osmo-hlr_10.42.42.2(pid=11521): Launched 13:39:52.222300 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:52.754037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11523): Launched 13:39:53.054150 run osmo-stp_10.42.42.5(pid=11524): Launched 13:39:53.167631 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:53.713613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11526): Launched 13:39:54.014914 run osmo-msc_10.42.42.6(pid=11527): Launched 13:39:54.183197 run osmo-stp_10.42.42.5(pid=11524): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11524)] 13:39:54.310316 run osmo-stp_10.42.42.5(pid=11524): stdout: | (launched: 2022-12-09_13:39:52.998706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:54.437337 run osmo-stp_10.42.42.5(pid=11524): stderr: | 20221209133953168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133953168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133953169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133953169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133953171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133953172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133953172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:54.562479 run osmo-stp_10.42.42.5(pid=11524): stdout: | (launched: 2022-12-09_13:39:52.998706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:54.682254 run osmo-stp_10.42.42.5(pid=11524): stderr: | 20221209133953168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209133953168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209133953169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209133953169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209133953171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209133953172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209133953172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:54.825232 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11524): Process ended prematurely: osmo-stp_10.42.42.5(pid=11524) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11524)] [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:39:54.834059 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:39:54.860303 run osmo-hlr_10.42.42.2(pid=11521): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11521)] 13:39:54.907155 run osmo-hlr_10.42.42.2(pid=11521): stdout: | (launched: 2022-12-09_13:39:52.051370) 13:39:54.955833 run osmo-hlr_10.42.42.2(pid=11521): stderr: | 20221209133952226 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209133952226 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209133952226 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209133952226 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209133952226 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209133952226 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209133952239 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209133952249 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209133952249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209133952250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:55.024232 run osmo-msc_10.42.42.6(pid=11527): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11527)] 13:39:55.071199 run osmo-msc_10.42.42.6(pid=11527): stdout: | (launched: 2022-12-09_13:39:53.959295) 13:39:55.119803 run osmo-msc_10.42.42.6(pid=11527): stderr: | 20221209133954231 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209133954232 DLGLOBAL DEBUG validating counter group 0x7f2893ef8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209133954232 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209133954232 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209133954232 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209133954232 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209133954235 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209133954236 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209133954236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209133954236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:39:55.168671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11520): Terminating (SIGTERM) 13:39:55.207956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11523): Terminating (SIGTERM) 13:39:55.247419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11526): Terminating (SIGTERM) 13:39:55.286944 --- ParallelTerminationStrategy: PID 11520 died... 13:39:55.306101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11520): Terminated: ok {rc=0} 13:39:55.349587 --- ParallelTerminationStrategy: PID 11523 died... 13:39:55.367913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11523): Terminated: ok {rc=0} 13:39:55.411434 --- ParallelTerminationStrategy: PID 11526 died... 13:39:55.429943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11526): Terminated: ok {rc=0} 13:39:55.512550 bus /sierra_3: Setting Powered False 13:39:56.606489 bus /sierra_3: Setting Powered False 13:39:57.720056 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:39:58.867608 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:58.880117 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:39:58.948241 tst mo_mt_call_osmux.py: using LAC 21839 13:39:59.075818 tst mo_mt_call_osmux.py: using RAC 164 13:39:59.201990 tst mo_mt_call_osmux.py: using CellId 21839 13:39:59.334544 tst mo_mt_call_osmux.py: using BVCI 21840 13:39:59.453814 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:59.465615 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:59.477168 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:59.489044 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:59.500873 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:59.512680 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:39:59.630184 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:39:59.746771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:00.215357 run create_hlr_db(pid=11529): Launched 13:40:00.339658 bus /sierra_2: Setting Powered False 13:40:01.417791 run create_hlr_db(pid=11529): Terminated: ok {rc=0} 13:40:01.877193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11535): Launched 13:40:02.198772 run osmo-hlr_10.42.42.2(pid=11536): Launched 13:40:02.431647 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:03.085064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11544): Launched 13:40:03.386272 run osmo-stp_10.42.42.5(pid=11545): Launched 13:40:03.503504 run osmo-msc_10.42.42.6: Starting osmo-msc 13:40:04.049664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11547): Launched 13:40:04.350953 run osmo-msc_10.42.42.6(pid=11548): Launched 13:40:04.518120 run osmo-stp_10.42.42.5(pid=11545): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11545)] 13:40:04.645320 run osmo-stp_10.42.42.5(pid=11545): stdout: | (launched: 2022-12-09_13:40:03.330652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:04.771733 run osmo-stp_10.42.42.5(pid=11545): stderr: | 20221209134003500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134003500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134003500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134003501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134003501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134003501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134003501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:04.896601 run osmo-stp_10.42.42.5(pid=11545): stdout: | (launched: 2022-12-09_13:40:03.330652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:05.015780 run osmo-stp_10.42.42.5(pid=11545): stderr: | 20221209134003500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134003500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134003500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134003501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134003501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134003501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134003501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:05.158849 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11545): Process ended prematurely: osmo-stp_10.42.42.5(pid=11545) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11545)] [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:40:05.167715 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:40:05.194064 run osmo-hlr_10.42.42.2(pid=11536): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11536)] 13:40:05.241144 run osmo-hlr_10.42.42.2(pid=11536): stdout: | (launched: 2022-12-09_13:40:02.142344) 13:40:05.289544 run osmo-hlr_10.42.42.2(pid=11536): stderr: | 20221209134002478 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134002478 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134002478 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134002478 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134002478 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134002478 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134002507 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134002515 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134002515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134002515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:05.357965 run osmo-msc_10.42.42.6(pid=11548): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11548)] 13:40:05.404881 run osmo-msc_10.42.42.6(pid=11548): stdout: | (launched: 2022-12-09_13:40:04.295335) 13:40:05.453629 run osmo-msc_10.42.42.6(pid=11548): stderr: | 20221209134004569 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134004569 DLGLOBAL DEBUG validating counter group 0x7fb0ff445c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134004570 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134004570 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134004570 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134004570 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134004572 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134004572 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134004572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134004572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:40:05.502742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11535): Terminating (SIGTERM) 13:40:05.542191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11544): Terminating (SIGTERM) 13:40:05.586697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11547): Terminating (SIGTERM) 13:40:05.629305 --- ParallelTerminationStrategy: PID 11535 died... 13:40:05.649352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11535): Terminated: ok {rc=0} 13:40:05.696068 --- ParallelTerminationStrategy: PID 11544 died... 13:40:05.715593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11544): Terminated: ok {rc=0} 13:40:05.762235 --- ParallelTerminationStrategy: PID 11547 died... 13:40:05.781903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11547): Terminated: ok {rc=0} 13:40:05.870240 bus /sierra_3: Setting Powered False 13:40:06.966183 bus /sierra_3: Setting Powered False 13:40:08.081278 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:40:09.328354 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:40:09.334731 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:40:09.363820 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:40:09.390484 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:40:09.443381 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:40:09.472868 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:40:09.499578 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:40:10.050532 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:40:10.098899 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:40:10.110263 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:40:10.174966 tst mo_mt_call.py: using LAC 21840 13:40:10.293538 tst mo_mt_call.py: using RAC 165 13:40:10.411762 tst mo_mt_call.py: using CellId 21840 13:40:10.529809 tst mo_mt_call.py: using BVCI 21841 13:40:10.638920 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:40:10.650249 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:40:10.661355 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:40:10.672267 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:40:10.683328 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:40:10.694637 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:40:10.808435 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:40:10.926054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:11.427838 run create_hlr_db(pid=11553): Launched 13:40:11.552125 bus /sierra_2: Setting Powered False 13:40:12.616770 run create_hlr_db(pid=11553): Terminated: ok {rc=0} 13:40:13.077752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11566): Launched 13:40:13.405710 run osmo-hlr_10.42.42.2(pid=11637): Launched 13:40:13.578144 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:14.196990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11741): Launched 13:40:14.514809 run osmo-stp_10.42.42.5(pid=11807): Launched 13:40:14.668106 run osmo-msc_10.42.42.6: Starting osmo-msc 13:40:15.270209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11913): Launched 13:40:15.587463 run osmo-msc_10.42.42.6(pid=11914): Launched 13:40:15.764557 run osmo-stp_10.42.42.5(pid=11807): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11807)] 13:40:16.003303 run osmo-stp_10.42.42.5(pid=11807): stdout: | (launched: 2022-12-09_13:40:14.458385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:16.253937 run osmo-stp_10.42.42.5(pid=11807): stderr: | 20221209134014717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134014717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134014717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134014718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134014718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134014718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134014718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:16.431887 run osmo-stp_10.42.42.5(pid=11807): stdout: | (launched: 2022-12-09_13:40:14.458385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:16.602438 run osmo-stp_10.42.42.5(pid=11807): stderr: | 20221209134014717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134014717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134014717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134014718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134014718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134014718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134014718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:16.806155 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11807): Process ended prematurely: osmo-stp_10.42.42.5(pid=11807) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11807)] [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:40:16.820881 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 13:40:16.850941 run osmo-hlr_10.42.42.2(pid=11637): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11637)] 13:40:16.900185 run osmo-hlr_10.42.42.2(pid=11637): stdout: | (launched: 2022-12-09_13:40:13.339559) 13:40:16.951500 run osmo-hlr_10.42.42.2(pid=11637): stderr: | 20221209134013569 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134013569 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134013569 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134013569 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134013569 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134013569 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134013594 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134013611 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134013611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134013611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:17.021183 run osmo-msc_10.42.42.6(pid=11914): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11914)] 13:40:17.069061 run osmo-msc_10.42.42.6(pid=11914): stdout: | (launched: 2022-12-09_13:40:15.529161) 13:40:17.118277 run osmo-msc_10.42.42.6(pid=11914): stderr: | 20221209134015855 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134015855 DLGLOBAL DEBUG validating counter group 0x7fdff3a50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134015855 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134015855 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134015855 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134015856 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134015857 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134015858 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134015858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134015858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:40:17.169161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11566): Terminating (SIGTERM) 13:40:17.209758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11741): Terminating (SIGTERM) 13:40:17.252426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11913): Terminating (SIGTERM) 13:40:17.295752 --- ParallelTerminationStrategy: PID 11566 died... 13:40:17.315183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11566): Terminated: ok {rc=0} 13:40:17.362162 --- ParallelTerminationStrategy: PID 11741 died... 13:40:17.381837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11741): Terminated: ok {rc=0} 13:40:17.425564 --- ParallelTerminationStrategy: PID 11913 died... 13:40:17.444632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11913): Terminated: ok {rc=0} 13:40:17.528393 bus /sierra_3: Setting Powered False 13:40:18.625751 bus /sierra_3: Setting Powered False 13:40:19.741689 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:40:20.887765 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:40:20.900427 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:40:20.971698 tst mo_mt_call_osmux.py: using LAC 21841 13:40:21.095644 tst mo_mt_call_osmux.py: using RAC 166 13:40:21.220176 tst mo_mt_call_osmux.py: using CellId 21841 13:40:21.342916 tst mo_mt_call_osmux.py: using BVCI 21842 13:40:21.458293 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:40:21.470172 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:40:21.481699 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:40:21.493480 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:40:21.505313 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:40:21.517063 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:40:21.633266 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:40:21.746722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:22.205520 run create_hlr_db(pid=11916): Launched 13:40:22.326700 bus /sierra_2: Setting Powered False 13:40:23.395436 run create_hlr_db(pid=11916): Terminated: ok {rc=0} 13:40:23.815791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12016): Launched 13:40:24.141692 run osmo-hlr_10.42.42.2(pid=12092): Launched 13:40:24.321675 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:24.969114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12096): Launched 13:40:25.303753 run osmo-stp_10.42.42.5(pid=12097): Launched 13:40:25.544700 run osmo-msc_10.42.42.6: Starting osmo-msc 13:40:26.212507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12099): Launched 13:40:26.552475 run osmo-msc_10.42.42.6(pid=12100): Launched 13:40:26.912627 run osmo-stp_10.42.42.5(pid=12097): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12097)] 13:40:27.199132 run osmo-stp_10.42.42.5(pid=12097): stdout: | (launched: 2022-12-09_13:40:25.243563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:27.368048 run osmo-stp_10.42.42.5(pid=12097): stderr: | 20221209134025534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134025534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134025534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134025535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134025535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134025535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134025535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:27.509208 run osmo-stp_10.42.42.5(pid=12097): stdout: | (launched: 2022-12-09_13:40:25.243563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:27.643256 run osmo-stp_10.42.42.5(pid=12097): stderr: | 20221209134025534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134025534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134025534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134025535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134025535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134025535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134025535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:27.802400 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12097): Process ended prematurely: osmo-stp_10.42.42.5(pid=12097) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12097)] [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:40:27.813355 tst mo_mt_call_osmux.py:8: Test FAILED (7.0 sec) 13:40:27.844858 run osmo-hlr_10.42.42.2(pid=12092): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12092)] 13:40:27.897903 run osmo-hlr_10.42.42.2(pid=12092): stdout: | (launched: 2022-12-09_13:40:24.080042) 13:40:27.953957 run osmo-hlr_10.42.42.2(pid=12092): stderr: | 20221209134024355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134024355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134024356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134024356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134024356 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134024356 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134024376 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134024392 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134024397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134024397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:28.029191 run osmo-msc_10.42.42.6(pid=12100): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12100)] 13:40:28.081945 run osmo-msc_10.42.42.6(pid=12100): stdout: | (launched: 2022-12-09_13:40:26.492223) 13:40:28.136891 run osmo-msc_10.42.42.6(pid=12100): stderr: | 20221209134026998 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134026998 DLGLOBAL DEBUG validating counter group 0x7f8ceb481c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134026998 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134026998 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134026998 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134026998 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134027000 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134027000 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134027001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134027001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:40:28.193275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12016): Terminating (SIGTERM) 13:40:28.237953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12096): Terminating (SIGTERM) 13:40:28.284358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12099): Terminating (SIGTERM) 13:40:28.330972 --- ParallelTerminationStrategy: PID 12016 died... 13:40:28.353336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12016): Terminated: ok {rc=0} 13:40:28.405733 --- ParallelTerminationStrategy: PID 12096 died... 13:40:28.427041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12096): Terminated: ok {rc=0} 13:40:28.477650 --- ParallelTerminationStrategy: PID 12099 died... 13:40:28.498869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12099): Terminated: ok {rc=0} 13:40:28.593602 bus /sierra_3: Setting Powered False 13:40:29.696742 bus /sierra_3: Setting Powered False 13:40:30.811150 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:40:32.068085 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:40:32.077226 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:40:32.120052 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:40:32.156935 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:40:32.215583 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:40:32.257665 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:40:32.294375 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:40:32.827977 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:40:32.881078 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:40:32.893190 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:40:32.960384 tst mo_mt_call.py: using LAC 21842 13:40:33.086751 tst mo_mt_call.py: using RAC 167 13:40:33.213223 tst mo_mt_call.py: using CellId 21842 13:40:33.340567 tst mo_mt_call.py: using BVCI 21843 13:40:33.458074 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:40:33.469955 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:40:33.481781 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:40:33.493866 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:40:33.505863 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:40:33.517896 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:40:33.639805 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:40:33.760296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:34.262750 run create_hlr_db(pid=12106): Launched 13:40:34.387676 bus /sierra_2: Setting Powered False 13:40:35.451194 run create_hlr_db(pid=12106): Terminated: ok {rc=0} 13:40:35.884300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12108): Launched 13:40:36.186189 run osmo-hlr_10.42.42.2(pid=12109): Launched 13:40:36.301872 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:36.822222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12111): Launched 13:40:37.123104 run osmo-stp_10.42.42.5(pid=12112): Launched 13:40:37.237171 run osmo-msc_10.42.42.6: Starting osmo-msc 13:40:37.782021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12114): Launched 13:40:38.084428 run osmo-msc_10.42.42.6(pid=12115): Launched 13:40:38.252640 run osmo-stp_10.42.42.5(pid=12112): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12112)] 13:40:38.381733 run osmo-stp_10.42.42.5(pid=12112): stdout: | (launched: 2022-12-09_13:40:37.067576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:38.509859 run osmo-stp_10.42.42.5(pid=12112): stderr: | 20221209134037238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134037239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134037239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134037239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134037240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134037240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134037240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:38.636038 run osmo-stp_10.42.42.5(pid=12112): stdout: | (launched: 2022-12-09_13:40:37.067576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:38.755759 run osmo-stp_10.42.42.5(pid=12112): stderr: | 20221209134037238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134037239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134037239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134037239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134037240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134037240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134037240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:38.899232 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12112): Process ended prematurely: osmo-stp_10.42.42.5(pid=12112) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12112)] [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:40:38.908174 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:40:38.934483 run osmo-hlr_10.42.42.2(pid=12109): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12109)] 13:40:38.981660 run osmo-hlr_10.42.42.2(pid=12109): stdout: | (launched: 2022-12-09_13:40:36.130855) 13:40:39.030514 run osmo-hlr_10.42.42.2(pid=12109): stderr: | 20221209134036307 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134036307 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134036307 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134036307 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134036307 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134036307 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134036322 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134036332 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134036332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134036332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:39.099167 run osmo-msc_10.42.42.6(pid=12115): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12115)] 13:40:39.146146 run osmo-msc_10.42.42.6(pid=12115): stdout: | (launched: 2022-12-09_13:40:38.028562) 13:40:39.194841 run osmo-msc_10.42.42.6(pid=12115): stderr: | 20221209134038303 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134038303 DLGLOBAL DEBUG validating counter group 0x7fd134c92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134038303 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134038303 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134038303 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134038304 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134038306 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134038307 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134038307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134038307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:40:39.243869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12108): Terminating (SIGTERM) 13:40:39.283272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12111): Terminating (SIGTERM) 13:40:39.322684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12114): Terminating (SIGTERM) 13:40:39.362270 --- ParallelTerminationStrategy: PID 12108 died... 13:40:39.381275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12108): Terminated: ok {rc=0} 13:40:39.424643 --- ParallelTerminationStrategy: PID 12111 died... 13:40:39.443339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12111): Terminated: ok {rc=0} 13:40:39.486745 --- ParallelTerminationStrategy: PID 12114 died... 13:40:39.505391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12114): Terminated: ok {rc=0} 13:40:39.587703 bus /sierra_3: Setting Powered False 13:40:40.682821 bus /sierra_3: Setting Powered False 13:40:41.794545 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:40:42.935748 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:40:42.947580 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:40:43.013385 tst mo_mt_call_osmux.py: using LAC 21843 13:40:43.134447 tst mo_mt_call_osmux.py: using RAC 168 13:40:43.253119 tst mo_mt_call_osmux.py: using CellId 21843 13:40:43.369840 tst mo_mt_call_osmux.py: using BVCI 21844 13:40:43.482922 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:40:43.494269 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:40:43.505514 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:40:43.516564 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:40:43.527819 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:40:43.538889 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:40:43.658952 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:40:43.776201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:44.244265 run create_hlr_db(pid=12117): Launched 13:40:44.367644 bus /sierra_2: Setting Powered False 13:40:45.429371 run create_hlr_db(pid=12117): Terminated: ok {rc=0} 13:40:45.879172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12119): Launched 13:40:46.243516 run osmo-hlr_10.42.42.2(pid=12120): Launched 13:40:46.459209 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:47.116807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12122): Launched 13:40:47.433784 run osmo-stp_10.42.42.5(pid=12123): Launched 13:40:47.549090 run osmo-msc_10.42.42.6: Starting osmo-msc 13:40:48.095726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12125): Launched 13:40:48.395697 run osmo-msc_10.42.42.6(pid=12126): Launched 13:40:48.563759 run osmo-stp_10.42.42.5(pid=12123): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12123)] 13:40:48.691492 run osmo-stp_10.42.42.5(pid=12123): stdout: | (launched: 2022-12-09_13:40:47.378278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:48.817997 run osmo-stp_10.42.42.5(pid=12123): stderr: | 20221209134047549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134047549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134047550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134047550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134047550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134047550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134047550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:48.942889 run osmo-stp_10.42.42.5(pid=12123): stdout: | (launched: 2022-12-09_13:40:47.378278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:49.062443 run osmo-stp_10.42.42.5(pid=12123): stderr: | 20221209134047549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134047549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134047550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134047550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134047550 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134047550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134047550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:49.206028 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12123): Process ended prematurely: osmo-stp_10.42.42.5(pid=12123) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12123)] [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:40:49.214956 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:40:49.241210 run osmo-hlr_10.42.42.2(pid=12120): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12120)] 13:40:49.288295 run osmo-hlr_10.42.42.2(pid=12120): stdout: | (launched: 2022-12-09_13:40:46.184816) 13:40:49.337073 run osmo-hlr_10.42.42.2(pid=12120): stderr: | 20221209134046562 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134046562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134046562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134046562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134046562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134046562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134046583 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134046600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134046606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134046606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:49.405302 run osmo-msc_10.42.42.6(pid=12126): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12126)] 13:40:49.452284 run osmo-msc_10.42.42.6(pid=12126): stdout: | (launched: 2022-12-09_13:40:48.339916) 13:40:49.500897 run osmo-msc_10.42.42.6(pid=12126): stderr: | 20221209134048611 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134048611 DLGLOBAL DEBUG validating counter group 0x7fe29a802c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134048611 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134048611 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134048611 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134048612 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134048613 DMNCC[1;39m DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134048615 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134048615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134048615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:40:49.549882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12119): Terminating (SIGTERM) 13:40:49.589158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12122): Terminating (SIGTERM) 13:40:49.628227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12125): Terminating (SIGTERM) 13:40:49.667726 --- ParallelTerminationStrategy: PID 12119 died... 13:40:49.686891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12119): Terminated: ok {rc=0} 13:40:49.730336 --- ParallelTerminationStrategy: PID 12122 died... 13:40:49.748896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12122): Terminated: ok {rc=0} 13:40:49.792143 --- ParallelTerminationStrategy: PID 12125 died... 13:40:49.810851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12125): Terminated: ok {rc=0} 13:40:49.895926 bus /sierra_3: Setting Powered False 13:40:50.995784 bus /sierra_3: Setting Powered False 13:40:52.108531 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:40:53.358260 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:40:53.365221 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:40:53.396344 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:40:53.423776 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:40:53.476672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:40:53.506624 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:40:53.534118 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:40:54.088456 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:40:54.136476 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:54.147882 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:40:54.213043 tst mo_mt_call.py: using LAC 21844 13:40:54.331740 tst mo_mt_call.py: using RAC 169 13:40:54.455373 tst mo_mt_call.py: using CellId 21844 13:40:54.581377 tst mo_mt_call.py: using BVCI 21845 13:40:54.699195 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:54.710989 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:54.722636 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:54.734490 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:54.746621 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:54.758415 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:40:54.874604 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:40:54.989160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:55.454947 run create_hlr_db(pid=12131): Launched 13:40:55.578630 bus /sierra_2: Setting Powered False 13:40:56.639161 run create_hlr_db(pid=12131): Terminated: ok {rc=0} 13:40:57.058135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12133): Launched 13:40:57.358937 run osmo-hlr_10.42.42.2(pid=12134): Launched 13:40:57.472715 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:57.989554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12136): Launched 13:40:58.291020 run osmo-stp_10.42.42.5(pid=12137): Launched 13:40:58.405559 run osmo-msc_10.42.42.6: Starting osmo-msc 13:40:58.949989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12139): Launched 13:40:59.251510 run osmo-msc_10.42.42.6(pid=12140): Launched 13:40:59.420357 run osmo-stp_10.42.42.5(pid=12137): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12137)] 13:40:59.547803 run osmo-stp_10.42.42.5(pid=12137): stdout: | (launched: 2022-12-09_13:40:58.235737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:59.675030 run osmo-stp_10.42.42.5(pid=12137): stderr: | 20221209134058405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134058405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134058406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134058406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134058407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134058407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134058407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:59.800167 run osmo-stp_10.42.42.5(pid=12137): stdout: | (launched: 2022-12-09_13:40:58.235737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:59.920393 run osmo-stp_10.42.42.5(pid=12137): stderr: | 20221209134058405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134058405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134058406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134058406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134058407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134058407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134058407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:00.064514 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12137): Process ended prematurely: osmo-stp_10.42.42.5(pid=12137) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12137)] [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:41:00.073674 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:41:00.100070 run osmo-hlr_10.42.42.2(pid=12134): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12134)] 13:41:00.147728 run osmo-hlr_10.42.42.2(pid=12134): stdout: | (launched: 2022-12-09_13:40:57.303968) 13:41:00.196871 run osmo-hlr_10.42.42.2(pid=12134): stderr: | 20221209134057479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134057479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134057480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134057480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134057480 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134057480 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134057493 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134057502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134057502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134057502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:00.265545 run osmo-msc_10.42.42.6(pid=12140): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12140)] 13:41:00.312563 run osmo-msc_10.42.42.6(pid=12140): stdout: | (launched: 2022-12-09_13:40:59.195852) 13:41:00.361398 run osmo-msc_10.42.42.6(pid=12140): stderr: | 20221209134059468 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134059468 DLGLOBAL DEBUG validating counter group 0x7f9bace2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134059468 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134059468 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134059469 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134059469 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134059471 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134059471 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134059471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134059471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:41:00.410515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12133): Terminating (SIGTERM) 13:41:00.450546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12136): Terminating (SIGTERM) 13:41:00.490058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12139): Terminating (SIGTERM) 13:41:00.529889 --- ParallelTerminationStrategy: PID 12133 died... 13:41:00.548727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12133): Terminated: ok {rc=0} 13:41:00.592758 --- ParallelTerminationStrategy: PID 12136 died... 13:41:00.611340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12136): Terminated: ok {rc=0} 13:41:00.655067 --- ParallelTerminationStrategy: PID 12139 died... 13:41:00.673733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12139): Terminated: ok {rc=0} 13:41:00.756733 bus /sierra_3: Setting Powered False 13:41:01.854064 bus /sierra_3: Setting Powered False 13:41:02.970992 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:41:04.120006 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:41:04.132433 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:41:04.202528 tst mo_mt_call_osmux.py: using LAC 21845 13:41:04.329914 tst mo_mt_call_osmux.py: using RAC 170 13:41:04.458365 tst mo_mt_call_osmux.py: using CellId 21845 13:41:04.584387 tst mo_mt_call_osmux.py: using BVCI 21846 13:41:04.703817 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:41:04.715571 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:41:04.727099 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:41:04.738973 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:41:04.750895 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:41:04.762628 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:41:04.882594 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:41:05.002629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:05.502235 run create_hlr_db(pid=12142): Launched 13:41:05.624641 bus /sierra_2: Setting Powered False 13:41:06.688401 run create_hlr_db(pid=12142): Terminated: ok {rc=0} 13:41:07.135196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12144): Launched 13:41:07.457660 run osmo-hlr_10.42.42.2(pid=12145): Launched 13:41:07.582409 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:08.140770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12147): Launched 13:41:08.461822 run osmo-stp_10.42.42.5(pid=12148): Launched 13:41:08.585297 run osmo-msc_10.42.42.6: Starting osmo-msc 13:41:09.168491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12150): Launched 13:41:09.493267 run osmo-msc_10.42.42.6(pid=12151): Launched 13:41:09.675520 run osmo-stp_10.42.42.5(pid=12148): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12148)] 13:41:09.811943 run osmo-stp_10.42.42.5(pid=12148): stdout: | (launched: 2022-12-09_13:41:08.403345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:09.949242 run osmo-stp_10.42.42.5(pid=12148): stderr: | 20221209134108594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134108594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134108595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134108595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134108596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134108596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134108596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:10.084860 run osmo-stp_10.42.42.5(pid=12148): stdout: | (launched: 2022-12-09_13:41:08.403345) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:10.213890 run osmo-stp_10.42.42.5(pid=12148): stderr: | 20221209134108594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134108594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134108595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134108595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134108596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134108596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134108596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:10.367728 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12148): Process ended prematurely: osmo-stp_10.42.42.5(pid=12148) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12148)] [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:41:10.377222 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:41:10.405599 run osmo-hlr_10.42.42.2(pid=12145): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12145)] 13:41:10.455338 run osmo-hlr_10.42.42.2(pid=12145): stdout: | (launched: 2022-12-09_13:41:07.399232) 13:41:10.507015 run osmo-hlr_10.42.42.2(pid=12145): stderr: | 20221209134107597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134107597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134107597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134107597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134107597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134107597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134107610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134107618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134107618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134107618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:10.579007 run osmo-msc_10.42.42.6(pid=12151): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12151)] 13:41:10.629136 run osmo-msc_10.42.42.6(pid=12151): stdout: | (launched: 2022-12-09_13:41:09.434370) 13:41:10.680622 run osmo-msc_10.42.42.6(pid=12151): stderr: | 20221209134109756 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134109756 DLGLOBAL DEBUG validating counter group 0x7f817ceb5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134109756 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134109757 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134109757 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134109757 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134109759 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134109759 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134109759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134109759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:41:10.732614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12144): Terminating (SIGTERM) 13:41:10.774675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12147): Terminating (SIGTERM) 13:41:10.816348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12150): Terminating (SIGTERM) 13:41:10.858115 --- ParallelTerminationStrategy: PID 12144 died... 13:41:10.878395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12144): Terminated: ok {rc=0} 13:41:10.924645 --- ParallelTerminationStrategy: PID 12147 died... 13:41:10.944298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12147): Terminated: ok {rc=0} 13:41:10.990292 --- ParallelTerminationStrategy: PID 12150 died... 13:41:11.009893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12150): Terminated: ok {rc=0} 13:41:11.098075 bus /sierra_3: Setting Powered False 13:41:12.196371 bus /sierra_3: Setting Powered False 13:41:13.311551 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:41:14.559584 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:41:14.566774 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:41:14.597429 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:41:14.625259 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:41:14.679667 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:41:14.710016 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:41:14.737521 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:41:15.289611 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:41:15.338966 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:41:15.350470 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:41:15.416450 tst mo_mt_call.py: using LAC 21846 13:41:15.534896 tst mo_mt_call.py: using RAC 171 13:41:15.655545 tst mo_mt_call.py: using CellId 21846 13:41:15.775731 tst mo_mt_call.py: using BVCI 21847 13:41:15.902384 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:41:15.914354 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:41:15.926207 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:41:15.938136 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:41:15.949972 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:41:15.961678 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:41:16.111113 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:41:16.251054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:16.769177 run create_hlr_db(pid=12156): Launched 13:41:16.928031 bus /sierra_2: Setting Powered False 13:41:17.988777 run create_hlr_db(pid=12156): Terminated: ok {rc=0} 13:41:18.484099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12158): Launched 13:41:18.808042 run osmo-hlr_10.42.42.2(pid=12159): Launched 13:41:18.930657 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:19.487247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12161): Launched 13:41:19.810482 run osmo-stp_10.42.42.5(pid=12162): Launched 13:41:19.932846 run osmo-msc_10.42.42.6: Starting osmo-msc 13:41:20.515325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12164): Launched 13:41:20.840259 run osmo-msc_10.42.42.6(pid=12165): Launched 13:41:21.021323 run osmo-stp_10.42.42.5(pid=12162): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12162)] 13:41:21.158662 run osmo-stp_10.42.42.5(pid=12162): stdout: | (launched: 2022-12-09_13:41:19.751853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:21.295699 run osmo-stp_10.42.42.5(pid=12162): stderr: | 20221209134119942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134119942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134119943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134119943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134119943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134119944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134119944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:21.431811 run osmo-stp_10.42.42.5(pid=12162): stdout: | (launched: 2022-12-09_13:41:19.751853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:21.560861 run osmo-stp_10.42.42.5(pid=12162): stderr: | 20221209134119942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134119942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134119943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134119943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134119943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134119944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134119944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:21.715954 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12162): Process ended prematurely: osmo-stp_10.42.42.5(pid=12162) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12162)] [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:41:21.725585 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:41:21.753698 run osmo-hlr_10.42.42.2(pid=12159): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12159)] 13:41:21.804234 run osmo-hlr_10.42.42.2(pid=12159): stdout: | (launched: 2022-12-09_13:41:18.748759) 13:41:21.856030 run osmo-hlr_10.42.42.2(pid=12159): stderr: | 20221209134118947 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134118947 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134118948 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134118948 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134118948 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134118948 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134118958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134118966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134118966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134118966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:21.928480 run osmo-msc_10.42.42.6(pid=12165): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12165)] 13:41:21.978583 run osmo-msc_10.42.42.6(pid=12165): stdout: | (launched: 2022-12-09_13:41:20.781478) 13:41:22.030567 run osmo-msc_10.42.42.6(pid=12165): stderr: | 20221209134121103 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134121103 DLGLOBAL DEBUG validating counter group 0x7fa64ecf9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134121103 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134121103 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134121103 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134121103 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134121105 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134121106 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134121106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134121106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:41:22.082805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12158): Terminating (SIGTERM) 13:41:22.124798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12161): Terminating (SIGTERM) 13:41:22.166862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12164): Terminating (SIGTERM) 13:41:22.209381 --- ParallelTerminationStrategy: PID 12158 died... 13:41:22.229446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12158): Terminated: ok {rc=0} 13:41:22.275964 --- ParallelTerminationStrategy: PID 12161 died... 13:41:22.295733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12161): Terminated: ok {rc=0} 13:41:22.342332 --- ParallelTerminationStrategy: PID 12164 died... 13:41:22.361930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12164): Terminated: ok {rc=0} 13:41:22.450140 bus /sierra_3: Setting Powered False 13:41:23.548934 bus /sierra_3: Setting Powered False 13:41:24.664067 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:41:25.812547 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:41:25.825163 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:41:25.893231 tst mo_mt_call_osmux.py: using LAC 21847 13:41:26.021359 tst mo_mt_call_osmux.py: using RAC 172 13:41:26.148361 tst mo_mt_call_osmux.py: using CellId 21847 13:41:26.276142 tst mo_mt_call_osmux.py: using BVCI 21848 13:41:26.395188 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:41:26.407055 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:41:26.418729 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:41:26.430670 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:41:26.442597 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:41:26.455160 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:41:26.575284 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:41:26.692651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:27.161225 run create_hlr_db(pid=12167): Launched 13:41:27.285148 bus /sierra_2: Setting Powered False 13:41:28.345592 run create_hlr_db(pid=12167): Terminated: ok {rc=0} 13:41:28.787088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12169): Launched 13:41:29.110207 run osmo-hlr_10.42.42.2(pid=12170): Launched 13:41:29.235136 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:29.771554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12172): Launched 13:41:30.073063 run osmo-stp_10.42.42.5(pid=12173): Launched 13:41:30.186911 run osmo-msc_10.42.42.6: Starting osmo-msc 13:41:30.733310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12175): Launched 13:41:31.077548 run osmo-msc_10.42.42.6(pid=12176): Launched 13:41:31.408528 run osmo-stp_10.42.42.5(pid=12173): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12173)] 13:41:31.769062 run osmo-stp_10.42.42.5(pid=12173): stdout: | (launched: 2022-12-09_13:41:30.017730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:32.133786 run osmo-stp_10.42.42.5(pid=12173): stderr: | 20221209134130188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134130188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134130188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134130189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134130189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134130189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134130189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:32.334626 run osmo-stp_10.42.42.5(pid=12173): stdout: | (launched: 2022-12-09_13:41:30.017730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:32.464851 run osmo-stp_10.42.42.5(pid=12173): stderr: | 20221209134130188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134130188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134130188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134130189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134130189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134130189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134130189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:32.619751 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12173): Process ended prematurely: osmo-stp_10.42.42.5(pid=12173) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12173)] [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:41:32.629507 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 13:41:32.658759 run osmo-hlr_10.42.42.2(pid=12170): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12170)] 13:41:32.709617 run osmo-hlr_10.42.42.2(pid=12170): stdout: | (launched: 2022-12-09_13:41:29.051723) 13:41:32.762315 run osmo-hlr_10.42.42.2(pid=12170): stderr: | 20221209134129248 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134129248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134129248 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134129248 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134129248 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134129248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134129259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134129268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134129268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134129268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:32.835813 run osmo-msc_10.42.42.6(pid=12176): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12176)] 13:41:32.886706 run osmo-msc_10.42.42.6(pid=12176): stdout: | (launched: 2022-12-09_13:41:31.012702) 13:41:32.939413 run osmo-msc_10.42.42.6(pid=12176): stderr: | 20221209134131799 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134131799 DLGLOBAL DEBUG validating counter group 0x7fa898b3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134131799 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134131799 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134131800 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134131800 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134131803 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134131805 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134131805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134131805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:41:32.992312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12169): Terminating (SIGTERM) 13:41:33.035035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12172): Terminating (SIGTERM) 13:41:33.077602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12175): Terminating (SIGTERM) 13:41:33.120528 --- ParallelTerminationStrategy: PID 12169 died... 13:41:33.140812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12169): Terminated: ok {rc=0} 13:41:33.187890 --- ParallelTerminationStrategy: PID 12172 died... 13:41:33.207936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12172): Terminated: ok {rc=0} 13:41:33.255386 --- ParallelTerminationStrategy: PID 12175 died... 13:41:33.275319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12175): Terminated: ok {rc=0} 13:41:33.365924 bus /sierra_3: Setting Powered False 13:41:34.464889 bus /sierra_3: Setting Powered False 13:41:35.583224 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:41:36.839414 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:41:36.845533 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:41:36.876628 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:41:36.904015 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:41:36.955961 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:41:36.985676 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:41:37.012904 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:41:37.565769 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:41:37.617623 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:41:37.629060 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:41:37.696444 tst mo_mt_call.py: using LAC 21848 13:41:37.821934 tst mo_mt_call.py: using RAC 173 13:41:37.948257 tst mo_mt_call.py: using CellId 21848 13:41:38.070026 tst mo_mt_call.py: using BVCI 21849 13:41:38.180084 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:41:38.191352 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:41:38.202386 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:41:38.214032 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:41:38.225607 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:41:38.237044 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:41:38.358710 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:41:38.477746 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:38.980274 run create_hlr_db(pid=12182): Launched 13:41:39.104108 bus /sierra_2: Setting Powered False 13:41:40.168317 run create_hlr_db(pid=12182): Terminated: ok {rc=0} 13:41:40.600174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12184): Launched 13:41:40.902497 run osmo-hlr_10.42.42.2(pid=12185): Launched 13:41:41.017188 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:41.551540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12187): Launched 13:41:41.854021 run osmo-stp_10.42.42.5(pid=12188): Launched 13:41:41.968719 run osmo-msc_10.42.42.6: Starting osmo-msc 13:41:42.515396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12190): Launched 13:41:42.817899 run osmo-msc_10.42.42.6(pid=12191): Launched 13:41:42.987549 run osmo-stp_10.42.42.5(pid=12188): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12188)] 13:41:43.116012 run osmo-stp_10.42.42.5(pid=12188): stdout: | (launched: 2022-12-09_13:41:41.797495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:43.243396 run osmo-stp_10.42.42.5(pid=12188): stderr: | 20221209134141967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134141967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134141968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134141968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134141969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134141969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134141969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:43.369068 run osmo-stp_10.42.42.5(pid=12188): stdout: | (launched: 2022-12-09_13:41:41.797495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:43.488818 run osmo-stp_10.42.42.5(pid=12188): stderr: | 20221209134141967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134141967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134141968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134141968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134141969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134141969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134141969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:43.632728 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12188): Process ended prematurely: osmo-stp_10.42.42.5(pid=12188) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12188)] [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:41:43.641735 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:41:43.667935 run osmo-hlr_10.42.42.2(pid=12185): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12185)] 13:41:43.714937 run osmo-hlr_10.42.42.2(pid=12185): stdout: | (launched: 2022-12-09_13:41:40.846710) 13:41:43.763649 run osmo-hlr_10.42.42.2(pid=12185): stderr: | 20221209134141021 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134141022 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134141022 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134141022 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134141022 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134141022 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134141034 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134141043 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134141043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134141043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:43.831804 run osmo-msc_10.42.42.6(pid=12191): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12191)] 13:41:43.879347 run osmo-msc_10.42.42.6(pid=12191): stdout: | (launched: 2022-12-09_13:41:42.762501) 13:41:43.928096 run osmo-msc_10.42.42.6(pid=12191): stderr: | 20221209134143034 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134143034 DLGLOBAL DEBUG validating counter group 0x7f4e8aecdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134143034 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134143034 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134143034 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134143034 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134143036 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134143036 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134143037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134143037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:41:43.977161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12184): Terminating (SIGTERM) 13:41:44.016927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12187): Terminating (SIGTERM) 13:41:44.056250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12190): Terminating (SIGTERM) 13:41:44.095913 --- ParallelTerminationStrategy: PID 12184 died... 13:41:44.115252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12184): Terminated: ok {rc=0} 13:41:44.158767 --- ParallelTerminationStrategy: PID 12187 died... 13:41:44.177330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12187): Terminated: ok {rc=0} 13:41:44.220761 --- ParallelTerminationStrategy: PID 12190 died... 13:41:44.239340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12190): Terminated: ok {rc=0} 13:41:44.321489 bus /sierra_3: Setting Powered False 13:41:45.416574 bus /sierra_3: Setting Powered False 13:41:46.526195 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:41:47.672211 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:41:47.683838 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:41:47.753327 tst mo_mt_call_osmux.py: using LAC 21849 13:41:47.871260 tst mo_mt_call_osmux.py: using RAC 174 13:41:47.988579 tst mo_mt_call_osmux.py: using CellId 21849 13:41:48.105455 tst mo_mt_call_osmux.py: using BVCI 21850 13:41:48.225876 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:41:48.237791 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:41:48.249352 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:41:48.261405 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:41:48.273927 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:41:48.285993 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:41:48.404039 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:41:48.523903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:49.025470 run create_hlr_db(pid=12193): Launched 13:41:49.150865 bus /sierra_2: Setting Powered False 13:41:50.215005 run create_hlr_db(pid=12193): Terminated: ok {rc=0} 13:41:50.664377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12195): Launched 13:41:50.986563 run osmo-hlr_10.42.42.2(pid=12196): Launched 13:41:51.110458 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:51.671208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12198): Launched 13:41:51.993686 run osmo-stp_10.42.42.5(pid=12199): Launched 13:41:52.119126 run osmo-msc_10.42.42.6: Starting osmo-msc 13:41:52.703443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12201): Launched 13:41:53.009483 run osmo-msc_10.42.42.6(pid=12202): Launched 13:41:53.178228 run osmo-stp_10.42.42.5(pid=12199): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12199)] 13:41:53.306215 run osmo-stp_10.42.42.5(pid=12199): stdout: | (launched: 2022-12-09_13:41:51.934972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:53.434011 run osmo-stp_10.42.42.5(pid=12199): stderr: | 20221209134152126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134152126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134152126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134152126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134152127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134152127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134152127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:53.560225 run osmo-stp_10.42.42.5(pid=12199): stdout: | (launched: 2022-12-09_13:41:51.934972) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:53.680418 run osmo-stp_10.42.42.5(pid=12199): stderr: | 20221209134152126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134152126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134152126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134152126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134152127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134152127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134152127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:53.824221 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12199): Process ended prematurely: osmo-stp_10.42.42.5(pid=12199) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12199)] [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:41:53.833413 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:41:53.860012 run osmo-hlr_10.42.42.2(pid=12196): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12196)] 13:41:53.907374 run osmo-hlr_10.42.42.2(pid=12196): stdout: | (launched: 2022-12-09_13:41:50.927822) 13:41:53.956600 run osmo-hlr_10.42.42.2(pid=12196): stderr: | 20221209134151127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134151127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134151127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134151127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134151127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134151127 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134151140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134151149 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134151149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134151149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:54.025753 run osmo-msc_10.42.42.6(pid=12202): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12202)] 13:41:54.073349 run osmo-msc_10.42.42.6(pid=12202): stdout: | (launched: 2022-12-09_13:41:52.953841) 13:41:54.122454 run osmo-msc_10.42.42.6(pid=12202): stderr: | 20221209134153226 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134153227 DLGLOBAL DEBUG validating counter group 0x7fda6740dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134153227 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134153227 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134153227 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134153227 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134153230 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134153230 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134153230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134153231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:41:54.171723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12195): Terminating (SIGTERM) 13:41:54.211232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12198): Terminating (SIGTERM) 13:41:54.251100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12201): Terminating (SIGTERM) 13:41:54.291271 --- ParallelTerminationStrategy: PID 12195 died... 13:41:54.310430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12195): Terminated: ok {rc=0} 13:41:54.354485 --- ParallelTerminationStrategy: PID 12198 died... 13:41:54.373180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12198): Terminated: ok {rc=0} 13:41:54.416906 --- ParallelTerminationStrategy: PID 12201 died... 13:41:54.435734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12201): Terminated: ok {rc=0} 13:41:54.519584 bus /sierra_3: Setting Powered False 13:41:55.615801 bus /sierra_3: Setting Powered False 13:41:56.729863 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 13:41:57.974906 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:41:57.979616 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:41:58.011041 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 13:41:58.039287 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 13:41:58.126970 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:41:58.156261 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 13:41:58.182794 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 13:41:58.770833 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2360 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 13:41:58.776047 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:41:58.787322 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:41:58.834431 tst emergency_mo_mt_call.py: using LAC 21850 13:41:58.965938 tst emergency_mo_mt_call.py: using RAC 175 13:41:59.090359 tst emergency_mo_mt_call.py: using CellId 21850 13:41:59.214687 tst emergency_mo_mt_call.py: using BVCI 21851 13:41:59.331511 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:41:59.342964 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:41:59.354283 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:41:59.365648 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:41:59.377109 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:41:59.388336 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:41:59.502692 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:41:59.620566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:00.113560 run create_hlr_db(pid=12207): Launched 13:42:00.235801 bus /sierra_2: Setting Powered False 13:42:01.297543 run create_hlr_db(pid=12207): Terminated: ok {rc=0} 13:42:01.836426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12210): Launched 13:42:02.150640 run osmo-hlr_10.42.42.2(pid=12211): Launched 13:42:02.335672 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:02.846938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12213): Launched 13:42:03.141461 run osmo-stp_10.42.42.5(pid=12214): Launched 13:42:03.265685 tst emergency_mo_mt_call.py: using MSISDN 7234 13:42:03.418207 run osmo-msc_10.42.42.6: Starting osmo-msc 13:42:03.954336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12216): Launched 13:42:04.251790 run osmo-msc_10.42.42.6(pid=12217): Launched 13:42:04.418855 run osmo-stp_10.42.42.5(pid=12214): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12214)] 13:42:04.543757 run osmo-stp_10.42.42.5(pid=12214): stdout: | (launched: 2022-12-09_13:42:03.087094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:04.670943 run osmo-stp_10.42.42.5(pid=12214): stderr: | 20221209134203257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134203258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134203258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134203258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134203259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134203259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134203259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:04.794384 run osmo-stp_10.42.42.5(pid=12214): stdout: | (launched: 2022-12-09_13:42:03.087094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:04.911481 run osmo-stp_10.42.42.5(pid=12214): stderr: | 20221209134203257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134203258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134203258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134203258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134203259 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134203259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134203259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:05.051962 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12214): Process ended prematurely: osmo-stp_10.42.42.5(pid=12214) [trial-2360↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12214)] [trial-2360↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 13:42:05.060483 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 13:42:05.086717 run osmo-hlr_10.42.42.2(pid=12211): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12211)] 13:42:05.134228 run osmo-hlr_10.42.42.2(pid=12211): stdout: | (launched: 2022-12-09_13:42:02.095240) 13:42:05.183371 run osmo-hlr_10.42.42.2(pid=12211): stderr: | 20221209134202324 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134202324 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134202324 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134202324 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134202324 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134202324 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134202364 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134202373 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134202373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134202374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:05.251773 run osmo-msc_10.42.42.6(pid=12217): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12217)] 13:42:05.299135 run osmo-msc_10.42.42.6(pid=12217): stdout: | (launched: 2022-12-09_13:42:04.197586) 13:42:05.348018 run osmo-msc_10.42.42.6(pid=12217): stderr: | 20221209134204467 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134204467 DLGLOBAL DEBUG validating counter group 0x7f086abfdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134204467 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134204467 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134204467 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134204468 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134204469 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134204471 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134204471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134204471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:42:05.397172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12210): Terminating (SIGTERM) 13:42:05.436623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12213): Terminating (SIGTERM) 13:42:05.476290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12216): Terminating (SIGTERM) 13:42:05.516274 --- ParallelTerminationStrategy: PID 12210 died... 13:42:05.535588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12210): Terminated: ok {rc=0} 13:42:05.579740 --- ParallelTerminationStrategy: PID 12213 died... 13:42:05.598699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12213): Terminated: ok {rc=0} 13:42:05.642517 --- ParallelTerminationStrategy: PID 12216 died... 13:42:05.661443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12216): Terminated: ok {rc=0} 13:42:05.744067 bus /sierra_3: Setting Powered False 13:42:06.841746 bus /sierra_3: Setting Powered False 13:42:07.956864 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 13:42:09.044176 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:42:09.056235 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:42:09.105252 tst emergency_preemptive_call.py: using LAC 21851 13:42:09.229562 tst emergency_preemptive_call.py: using RAC 176 13:42:09.354713 tst emergency_preemptive_call.py: using CellId 21851 13:42:09.478215 tst emergency_preemptive_call.py: using BVCI 21852 13:42:09.592721 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:42:09.604288 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:42:09.615503 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:42:09.626940 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:42:09.638419 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:42:09.649861 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:42:09.766171 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:42:09.885772 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:42:10.005495 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:42:10.124786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:10.616460 run create_hlr_db(pid=12219): Launched 13:42:10.738639 bus /sierra_2: Setting Powered False 13:42:11.801327 run create_hlr_db(pid=12219): Terminated: ok {rc=0} 13:42:12.243697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12221): Launched 13:42:12.560132 run osmo-hlr_10.42.42.2(pid=12222): Launched 13:42:12.682340 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:13.231604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12224): Launched 13:42:13.550353 run osmo-stp_10.42.42.5(pid=12225): Launched 13:42:13.683341 tst emergency_preemptive_call.py: using MSISDN 7235 13:42:13.847829 run osmo-msc_10.42.42.6: Starting osmo-msc 13:42:14.416519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12227): Launched 13:42:14.733477 run osmo-msc_10.42.42.6(pid=12228): Launched 13:42:14.910972 run osmo-stp_10.42.42.5(pid=12225): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12225)] 13:42:15.045816 run osmo-stp_10.42.42.5(pid=12225): stdout: | (launched: 2022-12-09_13:42:13.491536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:15.181443 run osmo-stp_10.42.42.5(pid=12225): stderr: | 20221209134213682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134213682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134213683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134213683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134213683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134213684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134213684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:15.316092 run osmo-stp_10.42.42.5(pid=12225): stdout: | (launched: 2022-12-09_13:42:13.491536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:15.442608 run osmo-stp_10.42.42.5(pid=12225): stderr: | 20221209134213682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134213682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134213683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134213683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134213683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134213684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134213684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:15.594274 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12225): Process ended prematurely: osmo-stp_10.42.42.5(pid=12225) [trial-2360↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12225)] [trial-2360↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 13:42:15.603057 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 13:42:15.631186 run osmo-hlr_10.42.42.2(pid=12222): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12222)] 13:42:15.681870 run osmo-hlr_10.42.42.2(pid=12222): stdout: | (launched: 2022-12-09_13:42:12.502328) 13:42:15.734237 run osmo-hlr_10.42.42.2(pid=12222): stderr: | 20221209134212699 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134212699 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134212699 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134212699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134212699 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134212699 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134212712 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134212721 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134212721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134212721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:15.807252 run osmo-msc_10.42.42.6(pid=12228): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12228)] 13:42:15.863498 run osmo-msc_10.42.42.6(pid=12228): stdout: | (launched: 2022-12-09_13:42:14.675383) 13:42:15.937748 run osmo-msc_10.42.42.6(pid=12228): stderr: | 20221209134214995 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134214995 DLGLOBAL DEBUG validating counter group 0x7f9048ed3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134214995 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134214995 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134214996 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134214996 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134214998 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134214998 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134214998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134214998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:42:15.990981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12221): Terminating (SIGTERM) 13:42:16.040328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12224): Terminating (SIGTERM) 13:42:16.086093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12227): Terminating (SIGTERM) 13:42:16.131112 --- ParallelTerminationStrategy: PID 12221 died... 13:42:16.152394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12221): Terminated: ok {rc=0} 13:42:16.201583 --- ParallelTerminationStrategy: PID 12224 died... 13:42:16.221698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12224): Terminated: ok {rc=0} 13:42:16.270227 --- ParallelTerminationStrategy: PID 12227 died... 13:42:16.290207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12227): Terminated: ok {rc=0} 13:42:16.381081 bus /sierra_9: Setting Powered False 13:42:17.481675 bus /sierra_9: Setting Powered False 13:42:18.598150 bus /sierra_8: Setting Powered False 13:42:19.697220 bus /sierra_8: Setting Powered False 13:42:20.812707 bus /sierra_3: Setting Powered False 13:42:21.912775 bus /sierra_3: Setting Powered False 13:42:23.029849 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 13:42:24.307704 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:42:24.312429 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:42:24.342858 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 13:42:24.383454 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 13:42:24.472308 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:42:24.502558 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 13:42:24.542892 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 13:42:25.138127 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 13:42:25.190868 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:25.202161 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:42:25.246724 tst cs_paging_gprs_active.py: using LAC 21852 13:42:25.373453 tst cs_paging_gprs_active.py: using RAC 177 13:42:25.500138 tst cs_paging_gprs_active.py: using CellId 21852 13:42:25.624850 tst cs_paging_gprs_active.py: using BVCI 21853 13:42:25.742346 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:25.753676 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:25.764505 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:25.775757 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:25.787414 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:25.798636 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:25.809978 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:25.820932 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:25.832350 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:42:25.949567 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:42:26.068776 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:42:26.287442 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:26.611476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12233): Launched 13:42:26.893520 run iperf3-srv_10.42.42.10(pid=12234): Launched 13:42:27.014503 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:42:27.232000 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:27.556581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12235): Launched 13:42:27.837077 run iperf3-srv_10.42.42.10(pid=12236): Launched 13:42:27.959410 tst cs_paging_gprs_active.py:38: start network... 13:42:28.176652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:28.677566 run create_hlr_db(pid=12237): Launched 13:42:28.802712 bus /sierra_2: Setting Powered False 13:42:29.866226 run create_hlr_db(pid=12237): Terminated: ok {rc=0} 13:42:30.315392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12239): Launched 13:42:30.640319 run osmo-hlr_10.42.42.2(pid=12240): Launched 13:42:30.764527 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:31.381691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12242): Launched 13:42:31.714739 run osmo-stp_10.42.42.5(pid=12243): Launched 13:42:31.958924 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:42:32.593166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12245): Launched 13:42:32.717270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:42:32.990601 run patchelf(pid=12246): Launched 13:42:33.170470 run osmo-stp_10.42.42.5(pid=12243): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12243)] 13:42:33.307326 run osmo-stp_10.42.42.5(pid=12243): stdout: | (launched: 2022-12-09_13:42:31.655378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:33.446326 run osmo-stp_10.42.42.5(pid=12243): stderr: | 20221209134231949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134231949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134231949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134231950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134231950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134231950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134231950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:33.585060 run osmo-stp_10.42.42.5(pid=12243): stdout: | (launched: 2022-12-09_13:42:31.655378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:33.718077 run osmo-stp_10.42.42.5(pid=12243): stderr: | 20221209134231949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134231949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134231949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134231950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134231950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134231950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134231950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:33.875443 run patchelf(pid=12246): Terminating (SIGINT) 13:42:34.055915 run patchelf(pid=12246): Terminated: ok {rc=0} 13:42:34.186157 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12243): Process ended prematurely: osmo-stp_10.42.42.5(pid=12243) [trial-2360↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12243)] [trial-2360↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 13:42:34.196450 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 13:42:34.225640 run osmo-hlr_10.42.42.2(pid=12240): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12240)] 13:42:34.275474 run osmo-hlr_10.42.42.2(pid=12240): stdout: | (launched: 2022-12-09_13:42:30.581482) 13:42:34.327377 run osmo-hlr_10.42.42.2(pid=12240): stderr: | 20221209134230780 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134230780 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134230780 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134230780 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134230780 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134230781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134230794 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134230802 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134230802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134230802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:34.379752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12233): Terminating (SIGTERM) 13:42:34.421748 run iperf3-srv_10.42.42.10(pid=12234): Terminating (SIGTERM) 13:42:34.463493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12235): Terminating (SIGTERM) 13:42:34.505517 run iperf3-srv_10.42.42.10(pid=12236): Terminating (SIGTERM) 13:42:34.547376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12239): Terminating (SIGTERM) 13:42:34.589470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12242): Terminating (SIGTERM) 13:42:34.631380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12245): Terminating (SIGTERM) 13:42:34.673979 --- ParallelTerminationStrategy: PID 12233 died... 13:42:34.694032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12233): Terminated: ok {rc=0} 13:42:34.740717 --- ParallelTerminationStrategy: PID 12234 died... 13:42:34.760209 run iperf3-srv_10.42.42.10(pid=12234): Terminated {rc=256} 13:42:34.806694 --- ParallelTerminationStrategy: PID 12235 died... 13:42:34.826322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12235): Terminated: ok {rc=0} 13:42:34.872544 --- ParallelTerminationStrategy: PID 12236 died... 13:42:34.892142 run iperf3-srv_10.42.42.10(pid=12236): Terminated {rc=256} 13:42:34.938202 --- ParallelTerminationStrategy: PID 12239 died... 13:42:34.957770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12239): Terminated: ok {rc=0} 13:42:35.004338 --- ParallelTerminationStrategy: PID 12242 died... 13:42:35.024000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12242): Terminated: ok {rc=0} 13:42:35.070288 --- ParallelTerminationStrategy: PID 12245 died... 13:42:35.089931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12245): Terminated: ok {rc=0} 13:42:35.176081 bus /gobi_0: Setting Powered False 13:42:36.274611 bus /gobi_0: Setting Powered False 13:42:37.388548 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 13:42:38.533571 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:38.545166 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:42:38.596009 tst iperf3.py: using LAC 21853 13:42:38.713987 tst iperf3.py: using RAC 178 13:42:38.831178 tst iperf3.py: using CellId 21853 13:42:38.948105 tst iperf3.py: using BVCI 21854 13:42:39.057411 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:39.068098 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:39.078602 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:39.089092 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:39.099450 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:39.110001 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:39.120658 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:39.131072 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:39.141670 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:42:39.260331 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:42:39.478719 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:39.803428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12248): Launched 13:42:40.086368 run iperf3-srv_10.42.42.10(pid=12249): Launched 13:42:40.209630 tst iperf3.py:8: start network... 13:42:40.426974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:40.927768 run create_hlr_db(pid=12250): Launched 13:42:41.050798 bus /gobi_6: Setting Powered False 13:42:42.114390 run create_hlr_db(pid=12250): Terminated: ok {rc=0} 13:42:42.563335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12252): Launched 13:42:42.887296 run osmo-hlr_10.42.42.2(pid=12253): Launched 13:42:43.011107 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:43.570056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12255): Launched 13:42:43.893970 run osmo-stp_10.42.42.5(pid=12256): Launched 13:42:44.019085 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:42:44.576722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12258): Launched 13:42:44.700919 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:42:44.975134 run patchelf(pid=12259): Launched 13:42:45.154964 run osmo-stp_10.42.42.5(pid=12256): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12256)] 13:42:45.292016 run osmo-stp_10.42.42.5(pid=12256): stdout: | (launched: 2022-12-09_13:42:43.835139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:45.430736 run osmo-stp_10.42.42.5(pid=12256): stderr: | 20221209134244027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134244027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134244027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134244028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134244028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134244028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134244028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:45.569558 run osmo-stp_10.42.42.5(pid=12256): stdout: | (launched: 2022-12-09_13:42:43.835139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:45.702938 run osmo-stp_10.42.42.5(pid=12256): stderr: | 20221209134244027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134244027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134244027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134244028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134244028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134244028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134244028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:45.861498 run patchelf(pid=12259): Terminating (SIGINT) 13:42:46.045998 run patchelf(pid=12259): Terminated: ok {rc=0} 13:42:46.179214 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12256): Process ended prematurely: osmo-stp_10.42.42.5(pid=12256) [trial-2360↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12256)] [trial-2360↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 13:42:46.190532 tst iperf3.py:8: Test FAILED (7.7 sec) 13:42:46.222279 run osmo-hlr_10.42.42.2(pid=12253): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12253)] 13:42:46.275023 run osmo-hlr_10.42.42.2(pid=12253): stdout: | (launched: 2022-12-09_13:42:42.827945) 13:42:46.329495 run osmo-hlr_10.42.42.2(pid=12253): stderr: | 20221209134243027 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134243027 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134243027 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134243027 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134243027 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134243027 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134243039 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134243048 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134243048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134243048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:46.384549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12248): Terminating (SIGTERM) 13:42:46.429196 run iperf3-srv_10.42.42.10(pid=12249): Terminating (SIGTERM) 13:42:46.474580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12252): Terminating (SIGTERM) 13:42:46.518992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12255): Terminating (SIGTERM) 13:42:46.563230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12258): Terminating (SIGTERM) 13:42:46.607758 --- ParallelTerminationStrategy: PID 12248 died... 13:42:46.628549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12248): Terminated: ok {rc=0} 13:42:46.678784 --- ParallelTerminationStrategy: PID 12249 died... 13:42:46.699490 run iperf3-srv_10.42.42.10(pid=12249): Terminated {rc=256} 13:42:46.749315 --- ParallelTerminationStrategy: PID 12252 died... 13:42:46.770154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12252): Terminated: ok {rc=0} 13:42:46.820041 --- ParallelTerminationStrategy: PID 12255 died... 13:42:46.840804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12255): Terminated: ok {rc=0} 13:42:46.891123 --- ParallelTerminationStrategy: PID 12258 died... 13:42:46.911876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12258): Terminated: ok {rc=0} 13:42:47.003207 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 13:42:48.150440 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:48.162175 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:42:48.206577 tst iperf3m4.py: using LAC 21854 13:42:48.324498 tst iperf3m4.py: using RAC 179 13:42:48.443477 tst iperf3m4.py: using CellId 21854 13:42:48.563691 tst iperf3m4.py: using BVCI 21855 13:42:48.673667 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:48.684668 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:48.695473 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:48.706209 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:48.716726 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:48.727218 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:48.737925 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:48.748277 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:42:48.759411 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:42:48.874604 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:42:48.993714 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:42:49.112686 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:42:49.237123 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:42:49.455127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:49.780334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12260): Launched 13:42:50.061359 run iperf3-srv_10.42.42.10(pid=12261): Launched 13:42:50.182997 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:42:50.400530 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:50.725495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12262): Launched 13:42:51.006677 run iperf3-srv_10.42.42.10(pid=12263): Launched 13:42:51.128347 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:42:51.345527 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:51.670045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12264): Launched 13:42:51.957317 run iperf3-srv_10.42.42.10(pid=12265): Launched 13:42:52.078852 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:42:52.295831 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:52.619579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12266): Launched 13:42:52.901716 run iperf3-srv_10.42.42.10(pid=12267): Launched 13:42:53.023573 tst iperf3m4.py:8: start network... 13:42:53.240806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:53.742168 run create_hlr_db(pid=12268): Launched 13:42:53.864693 bus /gobi_6: Setting Powered False 13:42:54.929216 run create_hlr_db(pid=12268): Terminated: ok {rc=0} 13:42:55.360433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12270): Launched 13:42:55.663263 run osmo-hlr_10.42.42.2(pid=12271): Launched 13:42:55.777990 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:56.410334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12273): Launched 13:42:56.705689 run osmo-stp_10.42.42.5(pid=12274): Launched 13:42:56.817500 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:42:57.329372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12276): Launched 13:42:57.441830 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:42:57.691844 run patchelf(pid=12277): Launched 13:42:57.856028 run osmo-stp_10.42.42.5(pid=12274): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12274)] 13:42:57.981180 run osmo-stp_10.42.42.5(pid=12274): stdout: | (launched: 2022-12-09_13:42:56.651135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:58.107875 run osmo-stp_10.42.42.5(pid=12274): stderr: | 20221209134256819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134256819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134256820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134256820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134256821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134256821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134256821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:58.234170 run osmo-stp_10.42.42.5(pid=12274): stdout: | (launched: 2022-12-09_13:42:56.651135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:58.355576 run osmo-stp_10.42.42.5(pid=12274): stderr: | 20221209134256819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134256819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134256820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134256820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134256821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134256821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134256821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:58.498996 run patchelf(pid=12277): Terminating (SIGINT) 13:42:58.664694 run patchelf(pid=12277): Terminated: ok {rc=0} 13:42:58.783429 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12274): Process ended prematurely: osmo-stp_10.42.42.5(pid=12274) [trial-2360↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12274)] [trial-2360↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 13:42:58.793388 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:42:58.820559 run osmo-hlr_10.42.42.2(pid=12271): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12271)] 13:42:58.867747 run osmo-hlr_10.42.42.2(pid=12271): stdout: | (launched: 2022-12-09_13:42:55.607166) 13:42:58.916612 run osmo-hlr_10.42.42.2(pid=12271): stderr: | 20221209134255781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134255781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134255781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134255781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134255781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134255781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134255793 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134255802 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134255802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134255802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:58.966243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12260): Terminating (SIGTERM) 13:42:59.005801 run iperf3-srv_10.42.42.10(pid=12261): Terminating (SIGTERM) 13:42:59.045209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12262): Terminating (SIGTERM) 13:42:59.084567 run iperf3-srv_10.42.42.10(pid=12263): Terminating (SIGTERM) 13:42:59.123709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12264): Terminating (SIGTERM) 13:42:59.162899 run iperf3-srv_10.42.42.10(pid=12265): Terminating (SIGTERM) 13:42:59.201867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12266): Terminating (SIGTERM) 13:42:59.241066 run iperf3-srv_10.42.42.10(pid=12267): Terminating (SIGTERM) 13:42:59.280064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12270): Terminating (SIGTERM) 13:42:59.319673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12273): Terminating (SIGTERM) 13:42:59.358845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12276): Terminating (SIGTERM) 13:42:59.398345 --- ParallelTerminationStrategy: PID 12260 died... 13:42:59.417356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12260): Terminated: ok {rc=0} 13:42:59.460716 --- ParallelTerminationStrategy: PID 12261 died... 13:42:59.479314 run iperf3-srv_10.42.42.10(pid=12261): Terminated {rc=256} 13:42:59.522630 --- ParallelTerminationStrategy: PID 12262 died... 13:42:59.541332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12262): Terminated: ok {rc=0} 13:42:59.584683 --- ParallelTerminationStrategy: PID 12263 died... 13:42:59.603220 run iperf3-srv_10.42.42.10(pid=12263): Terminated {rc=256} 13:42:59.646516 --- ParallelTerminationStrategy: PID 12264 died... 13:42:59.665335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12264): Terminated: ok {rc=0} 13:42:59.708764 --- ParallelTerminationStrategy: PID 12265 died... 13:42:59.727425 run iperf3-srv_10.42.42.10(pid=12265): Terminated {rc=256} 13:42:59.770755 --- ParallelTerminationStrategy: PID 12266 died... 13:42:59.789413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12266): Terminated: ok {rc=0} 13:42:59.833582 --- ParallelTerminationStrategy: PID 12267 died... 13:42:59.852161 run iperf3-srv_10.42.42.10(pid=12267): Terminated {rc=256} 13:42:59.895862 --- ParallelTerminationStrategy: PID 12270 died... 13:42:59.914699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12270): Terminated: ok {rc=0} 13:42:59.958028 --- ParallelTerminationStrategy: PID 12273 died... 13:42:59.976387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12273): Terminated: ok {rc=0} 13:43:00.020303 --- ParallelTerminationStrategy: PID 12276 died... 13:43:00.039049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12276): Terminated: ok {rc=0} 13:43:00.123805 bus /gobi_4: Setting Powered False 13:43:01.224406 bus /gobi_4: Setting Powered False 13:43:02.340108 bus /gobi_1: Setting Powered False 13:43:03.437600 bus /gobi_1: Setting Powered False 13:43:04.553056 bus /gobi_0: Setting Powered False 13:43:05.650417 bus /gobi_0: Setting Powered False 13:43:06.768721 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 13:43:07.870984 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:43:07.882726 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:43:07.929128 tst ping.py: using LAC 21855 13:43:08.051276 tst ping.py: using RAC 180 13:43:08.172493 tst ping.py: using CellId 21855 13:43:08.293762 tst ping.py: using BVCI 21856 13:43:08.408065 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:43:08.419504 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:43:08.430604 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:43:08.441896 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:43:08.453085 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:43:08.464132 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:43:08.475451 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:43:08.486773 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:43:08.599138 tst ping.py:19: start network... 13:43:08.794638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:09.247476 run create_hlr_db(pid=12278): Launched 13:43:09.367630 bus /gobi_6: Setting Powered False 13:43:10.425728 run create_hlr_db(pid=12278): Terminated: ok {rc=0} 13:43:10.853935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12280): Launched 13:43:11.165451 run osmo-hlr_10.42.42.2(pid=12281): Launched 13:43:11.284538 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:11.827559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12283): Launched 13:43:12.140801 run osmo-stp_10.42.42.5(pid=12284): Launched 13:43:12.260398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:43:12.799339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12286): Launched 13:43:12.918422 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:43:13.181642 run patchelf(pid=12287): Launched 13:43:13.354617 run osmo-stp_10.42.42.5(pid=12284): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12284)] 13:43:13.486671 run osmo-stp_10.42.42.5(pid=12284): stdout: | (launched: 2022-12-09_13:43:12.083442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:13.620181 run osmo-stp_10.42.42.5(pid=12284): stderr: | 20221209134312273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134312273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134312273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134312274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134312274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134312274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134312274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:13.754705 run osmo-stp_10.42.42.5(pid=12284): stdout: | (launched: 2022-12-09_13:43:12.083442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:13.882604 run osmo-stp_10.42.42.5(pid=12284): stderr: | 20221209134312273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134312273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134312273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134312274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134312274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134312274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134312274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:14.034112 run patchelf(pid=12287): Terminating (SIGINT) 13:43:14.207876 run patchelf(pid=12287): Terminated: ok {rc=0} 13:43:14.333661 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12284): Process ended prematurely: osmo-stp_10.42.42.5(pid=12284) [trial-2360↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12284)] [trial-2360↪gprs:trx-lms-limenet-micro↪ping.py:22] 13:43:14.343279 tst ping.py:22: Test FAILED (6.5 sec) 13:43:14.371458 run osmo-hlr_10.42.42.2(pid=12281): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12281)] 13:43:14.421817 run osmo-hlr_10.42.42.2(pid=12281): stdout: | (launched: 2022-12-09_13:43:11.108138) 13:43:14.473789 run osmo-hlr_10.42.42.2(pid=12281): stderr: | 20221209134311303 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134311303 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134311303 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134311303 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134311303 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134311303 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134311315 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134311325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134311326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134311326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:14.526130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12280): Terminating (SIGTERM) 13:43:14.568049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12283): Terminating (SIGTERM) 13:43:14.609920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12286): Terminating (SIGTERM) 13:43:14.651947 --- ParallelTerminationStrategy: PID 12280 died... 13:43:14.671820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12280): Terminated: ok {rc=0} 13:43:14.718483 --- ParallelTerminationStrategy: PID 12283 died... 13:43:14.738044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12283): Terminated: ok {rc=0} 13:43:14.784130 --- ParallelTerminationStrategy: PID 12286 died... 13:43:14.803513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12286): Terminated: ok {rc=0} 13:43:14.890944 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 13:43:15.981385 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:43:15.994081 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:43:16.046748 tst ping_idle_ping.py: using LAC 21856 13:43:16.199734 tst ping_idle_ping.py: using RAC 181 13:43:16.319310 tst ping_idle_ping.py: using CellId 21856 13:43:16.435662 tst ping_idle_ping.py: using BVCI 21857 13:43:16.545364 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:43:16.556827 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:43:16.568336 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:43:16.580598 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:43:16.592246 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:43:16.604243 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:43:16.615935 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:43:16.627693 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:43:16.772889 tst ping_idle_ping.py:24: start network... 13:43:16.999130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:17.464061 run create_hlr_db(pid=12288): Launched 13:43:17.586350 bus /gobi_6: Setting Powered False 13:43:18.644713 run create_hlr_db(pid=12288): Terminated: ok {rc=0} 13:43:19.074121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12290): Launched 13:43:19.387886 run osmo-hlr_10.42.42.2(pid=12291): Launched 13:43:19.506747 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:20.049613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12293): Launched 13:43:20.362518 run osmo-stp_10.42.42.5(pid=12294): Launched 13:43:20.481234 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:43:21.022056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12296): Launched 13:43:21.142344 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:43:21.407689 run patchelf(pid=12297): Launched 13:43:21.581530 run osmo-stp_10.42.42.5(pid=12294): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12294)] 13:43:21.715076 run osmo-stp_10.42.42.5(pid=12294): stdout: | (launched: 2022-12-09_13:43:20.305065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:21.849963 run osmo-stp_10.42.42.5(pid=12294): stderr: | 20221209134320494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134320494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134320495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134320495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134320496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134320496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134320496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:21.985069 run osmo-stp_10.42.42.5(pid=12294): stdout: | (launched: 2022-12-09_13:43:20.305065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:22.114055 run osmo-stp_10.42.42.5(pid=12294): stderr: | 20221209134320494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134320494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134320495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134320495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134320496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134320496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134320496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:22.266773 run patchelf(pid=12297): Terminating (SIGINT) 13:43:22.441936 run patchelf(pid=12297): Terminated: ok {rc=0} 13:43:22.568347 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12294): Process ended prematurely: osmo-stp_10.42.42.5(pid=12294) [trial-2360↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12294)] [trial-2360↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 13:43:22.578039 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:43:22.606023 run osmo-hlr_10.42.42.2(pid=12291): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12291)] 13:43:22.656558 run osmo-hlr_10.42.42.2(pid=12291): stdout: | (launched: 2022-12-09_13:43:19.330656) 13:43:22.709078 run osmo-hlr_10.42.42.2(pid=12291): stderr: | 20221209134319527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134319527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134319527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134319527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134319527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134319527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134319540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134319550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134319551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134319551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:22.761644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12290): Terminating (SIGTERM) 13:43:22.803838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12293): Terminating (SIGTERM) 13:43:22.846016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12296): Terminating (SIGTERM) 13:43:22.888188 --- ParallelTerminationStrategy: PID 12290 died... 13:43:22.908115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12290): Terminated: ok {rc=0} 13:43:22.954452 --- ParallelTerminationStrategy: PID 12293 died... 13:43:22.974048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12293): Terminated: ok {rc=0} 13:43:23.020129 --- ParallelTerminationStrategy: PID 12296 died... 13:43:23.039542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12296): Terminated: ok {rc=0} 13:43:23.127091 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 13:43:24.431954 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:43:24.438208 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:43:24.468546 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:43:24.507469 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:43:24.594509 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:43:24.623913 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:43:24.662752 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:43:25.262138 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:43:25.315164 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:25.326818 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:43:25.374245 tst cs_paging_gprs_active.py: using LAC 21857 13:43:25.501116 tst cs_paging_gprs_active.py: using RAC 182 13:43:25.625368 tst cs_paging_gprs_active.py: using CellId 21857 13:43:25.750722 tst cs_paging_gprs_active.py: using BVCI 21858 13:43:25.860488 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:25.871506 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:25.882472 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:25.893168 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:25.904712 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:25.916016 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:25.927257 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:25.938386 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:25.949837 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:43:26.066313 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:43:26.186685 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:43:26.402652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:26.723273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12301): Launched 13:43:27.000804 run iperf3-srv_10.42.42.10(pid=12302): Launched 13:43:27.120642 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:43:27.336555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:27.657373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12304): Launched 13:43:27.934688 run iperf3-srv_10.42.42.10(pid=12305): Launched 13:43:28.053715 tst cs_paging_gprs_active.py:38: start network... 13:43:28.268294 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:28.763202 run create_hlr_db(pid=12306): Launched 13:43:28.884763 bus /gobi_6: Setting Powered False 13:43:29.947603 run create_hlr_db(pid=12306): Terminated: ok {rc=0} 13:43:30.373901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12308): Launched 13:43:30.671651 run osmo-hlr_10.42.42.2(pid=12309): Launched 13:43:30.785986 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:31.458199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12311): Launched 13:43:31.800331 run osmo-stp_10.42.42.5(pid=12312): Launched 13:43:32.039568 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:43:32.615074 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12314): Launched 13:43:32.729409 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:43:32.981780 run patchelf(pid=12315): Launched 13:43:33.147719 run osmo-stp_10.42.42.5(pid=12312): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12312)] 13:43:33.274933 run osmo-stp_10.42.42.5(pid=12312): stdout: | (launched: 2022-12-09_13:43:31.738934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:33.403047 run osmo-stp_10.42.42.5(pid=12312): stderr: | 20221209134332041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134332041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134332041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134332042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134332042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134332043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134332043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:33.531015 run osmo-stp_10.42.42.5(pid=12312): stdout: | (launched: 2022-12-09_13:43:31.738934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:33.653640 run osmo-stp_10.42.42.5(pid=12312): stderr: | 20221209134332041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134332041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134332041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134332042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134332042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134332043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134332043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:33.798495 run patchelf(pid=12315): Terminating (SIGINT) 13:43:33.965156 run patchelf(pid=12315): Terminated: ok {rc=0} 13:43:34.085395 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12312): Process ended prematurely: osmo-stp_10.42.42.5(pid=12312) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12312)] [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:43:34.095028 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:43:34.122449 run osmo-hlr_10.42.42.2(pid=12309): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12309)] 13:43:34.170091 run osmo-hlr_10.42.42.2(pid=12309): stdout: | (launched: 2022-12-09_13:43:30.616709) 13:43:34.219367 run osmo-hlr_10.42.42.2(pid=12309): stderr: | 20221209134330793 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134330793 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134330793 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134330793 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134330793 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134330793 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134330805 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134330813 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134330814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134330814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:34.269186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12301): Terminating (SIGTERM) 13:43:34.309144 run iperf3-srv_10.42.42.10(pid=12302): Terminating (SIGTERM) 13:43:34.348819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12304): Terminating (SIGTERM) 13:43:34.388551 run iperf3-srv_10.42.42.10(pid=12305): Terminating (SIGTERM) 13:43:34.428338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12308): Terminating (SIGTERM) 13:43:34.468195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12311): Terminating (SIGTERM) 13:43:34.507815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12314): Terminating (SIGTERM) 13:43:34.547647 --- ParallelTerminationStrategy: PID 12301 died... 13:43:34.566770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12301): Terminated: ok {rc=0} 13:43:34.610587 --- ParallelTerminationStrategy: PID 12302 died... 13:43:34.629131 run iperf3-srv_10.42.42.10(pid=12302): Terminated {rc=256} 13:43:34.672472 --- ParallelTerminationStrategy: PID 12304 died... 13:43:34.691006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12304): Terminated: ok {rc=0} 13:43:34.734769 --- ParallelTerminationStrategy: PID 12305 died... 13:43:34.753309 run iperf3-srv_10.42.42.10(pid=12305): Terminated {rc=256} 13:43:34.796596 --- ParallelTerminationStrategy: PID 12308 died... 13:43:34.815338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12308): Terminated: ok {rc=0} 13:43:34.858779 --- ParallelTerminationStrategy: PID 12311 died... 13:43:34.877281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12311): Terminated: ok {rc=0} 13:43:34.920766 --- ParallelTerminationStrategy: PID 12314 died... 13:43:34.939553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12314): Terminated: ok {rc=0} 13:43:35.024205 bus /gobi_0: Setting Powered False 13:43:36.123819 bus /gobi_0: Setting Powered False 13:43:37.239899 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:43:38.387062 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:38.398561 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:43:38.447803 tst iperf3.py: using LAC 21858 13:43:38.565310 tst iperf3.py: using RAC 183 13:43:38.690187 tst iperf3.py: using CellId 21858 13:43:38.815847 tst iperf3.py: using BVCI 21859 13:43:38.933620 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:38.945451 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:38.956832 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:38.968766 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:38.980818 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:38.992728 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:39.004754 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:39.016633 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:39.028589 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:43:39.146460 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:43:39.346441 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:39.645697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12316): Launched 13:43:39.905982 run iperf3-srv_10.42.42.10(pid=12317): Launched 13:43:40.017846 tst iperf3.py:8: start network... 13:43:40.216788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:40.678974 run create_hlr_db(pid=12318): Launched 13:43:40.803100 bus /gobi_6: Setting Powered False 13:43:41.862409 run create_hlr_db(pid=12318): Terminated: ok {rc=0} 13:43:42.278036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12320): Launched 13:43:42.576561 run osmo-hlr_10.42.42.2(pid=12321): Launched 13:43:42.690221 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:43.201383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12323): Launched 13:43:43.499492 run osmo-stp_10.42.42.5(pid=12324): Launched 13:43:43.612389 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:43:44.125323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12326): Launched 13:43:44.238963 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:43:44.490596 run patchelf(pid=12327): Launched 13:43:44.655165 run osmo-stp_10.42.42.5(pid=12324): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12324)] 13:43:44.781096 run osmo-stp_10.42.42.5(pid=12324): stdout: | (launched: 2022-12-09_13:43:43.444631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:44.908449 run osmo-stp_10.42.42.5(pid=12324): stderr: | 20221209134343618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134343618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134343618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134343619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134343619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134343619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134343619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:45.035894 run osmo-stp_10.42.42.5(pid=12324): stdout: | (launched: 2022-12-09_13:43:43.444631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:45.157617 run osmo-stp_10.42.42.5(pid=12324): stderr: | 20221209134343618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134343618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134343618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134343619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134343619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134343619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134343619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:45.302279 run patchelf(pid=12327): Terminating (SIGINT) 13:43:45.468706 run patchelf(pid=12327): Terminated: ok {rc=0} 13:43:45.587851 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12324): Process ended prematurely: osmo-stp_10.42.42.5(pid=12324) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12324)] [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 13:43:45.597431 tst iperf3.py:8: Test FAILED (7.2 sec) 13:43:45.624308 run osmo-hlr_10.42.42.2(pid=12321): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12321)] 13:43:45.671475 run osmo-hlr_10.42.42.2(pid=12321): stdout: | (launched: 2022-12-09_13:43:42.521324) 13:43:45.720418 run osmo-hlr_10.42.42.2(pid=12321): stderr: | 20221209134342697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134342697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134342697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134342697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134342697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134342697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134342710 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134342720 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134342721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134342721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:45.769856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12316): Terminating (SIGTERM) 13:43:45.809607 run iperf3-srv_10.42.42.10(pid=12317): Terminating (SIGTERM) 13:43:45.849361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12320): Terminating (SIGTERM) 13:43:45.904692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12323): Terminating (SIGTERM) 13:43:45.945025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12326): Terminating (SIGTERM) 13:43:45.985994 --- ParallelTerminationStrategy: PID 12316 died... 13:43:46.005329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12316): Terminated: ok {rc=0} 13:43:46.051284 --- ParallelTerminationStrategy: PID 12317 died... 13:43:46.070321 run iperf3-srv_10.42.42.10(pid=12317): Terminated {rc=256} 13:43:46.114390 --- ParallelTerminationStrategy: PID 12320 died... 13:43:46.133378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12320): Terminated: ok {rc=0} 13:43:46.177478 --- ParallelTerminationStrategy: PID 12323 died... 13:43:46.196383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12323): Terminated: ok {rc=0} 13:43:46.240579 --- ParallelTerminationStrategy: PID 12326 died... 13:43:46.259679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12326): Terminated: ok {rc=0} 13:43:46.344400 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:43:47.486978 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:47.498698 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:43:47.546797 tst iperf3m4.py: using LAC 21859 13:43:47.664908 tst iperf3m4.py: using RAC 184 13:43:47.781952 tst iperf3m4.py: using CellId 21859 13:43:47.908130 tst iperf3m4.py: using BVCI 21860 13:43:48.025727 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:48.037502 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:48.049084 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:48.060861 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:48.072641 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:48.084596 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:48.096690 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:48.108456 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:48.120505 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:43:48.246797 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:43:48.362216 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:43:48.476489 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:43:48.596346 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:43:48.812346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:49.132636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12328): Launched 13:43:49.409878 run iperf3-srv_10.42.42.10(pid=12329): Launched 13:43:49.529820 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:43:49.744375 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:50.064222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12330): Launched 13:43:50.341707 run iperf3-srv_10.42.42.10(pid=12331): Launched 13:43:50.461587 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:43:50.675790 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:50.996349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12332): Launched 13:43:51.273548 run iperf3-srv_10.42.42.10(pid=12333): Launched 13:43:51.393998 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:43:51.608352 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:51.929135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12334): Launched 13:43:52.205588 run iperf3-srv_10.42.42.10(pid=12335): Launched 13:43:52.325198 tst iperf3m4.py:8: start network... 13:43:52.539020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:53.036531 run create_hlr_db(pid=12336): Launched 13:43:53.158456 bus /gobi_6: Setting Powered False 13:43:54.221552 run create_hlr_db(pid=12336): Terminated: ok {rc=0} 13:43:54.666117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12338): Launched 13:43:54.985100 run osmo-hlr_10.42.42.2(pid=12339): Launched 13:43:55.106752 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:55.660415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12341): Launched 13:43:55.979440 run osmo-stp_10.42.42.5(pid=12342): Launched 13:43:56.100525 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:43:56.649437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12344): Launched 13:43:56.771286 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:43:57.040744 run patchelf(pid=12345): Launched 13:43:57.217496 run osmo-stp_10.42.42.5(pid=12342): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12342)] 13:43:57.352851 run osmo-stp_10.42.42.5(pid=12342): stdout: | (launched: 2022-12-09_13:43:55.921047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:57.490197 run osmo-stp_10.42.42.5(pid=12342): stderr: | 20221209134356107 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134356107 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134356107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134356107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134356108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134356108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134356108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:57.627514 run osmo-stp_10.42.42.5(pid=12342): stdout: | (launched: 2022-12-09_13:43:55.921047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:57.759542 run osmo-stp_10.42.42.5(pid=12342): stderr: | 20221209134356107 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134356107 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134356107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134356107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134356108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134356108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134356108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:57.915262 run patchelf(pid=12345): Terminating (SIGINT) 13:43:58.093320 run patchelf(pid=12345): Terminated: ok {rc=0} 13:43:58.221982 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12342): Process ended prematurely: osmo-stp_10.42.42.5(pid=12342) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12342)] [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 13:43:58.232295 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:43:58.262004 run osmo-hlr_10.42.42.2(pid=12339): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12339)] 13:43:58.312687 run osmo-hlr_10.42.42.2(pid=12339): stdout: | (launched: 2022-12-09_13:43:54.926832) 13:43:58.364888 run osmo-hlr_10.42.42.2(pid=12339): stderr: | 20221209134355122 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134355122 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134355122 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134355122 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134355122 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134355122 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134355137 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134355147 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134355147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134355147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:58.417520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12328): Terminating (SIGTERM) 13:43:58.459646 run iperf3-srv_10.42.42.10(pid=12329): Terminating (SIGTERM) 13:43:58.501799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12330): Terminating (SIGTERM) 13:43:58.544030 run iperf3-srv_10.42.42.10(pid=12331): Terminating (SIGTERM) 13:43:58.586173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12332): Terminating (SIGTERM) 13:43:58.628477 run iperf3-srv_10.42.42.10(pid=12333): Terminating (SIGTERM) 13:43:58.670753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12334): Terminating (SIGTERM) 13:43:58.713551 run iperf3-srv_10.42.42.10(pid=12335): Terminating (SIGTERM) 13:43:58.755861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12338): Terminating (SIGTERM) 13:43:58.798434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12341): Terminating (SIGTERM) 13:43:58.840636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12344): Terminating (SIGTERM) 13:43:58.883085 --- ParallelTerminationStrategy: PID 12328 died... 13:43:58.903124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12328): Terminated: ok {rc=0} 13:43:58.950141 --- ParallelTerminationStrategy: PID 12329 died... 13:43:58.969722 run iperf3-srv_10.42.42.10(pid=12329): Terminated {rc=256} 13:43:59.016222 --- ParallelTerminationStrategy: PID 12330 died... 13:43:59.035961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12330): Terminated: ok {rc=0} 13:43:59.082828 --- ParallelTerminationStrategy: PID 12331 died... 13:43:59.102506 run iperf3-srv_10.42.42.10(pid=12331): Terminated {rc=256} 13:43:59.149259 --- ParallelTerminationStrategy: PID 12332 died... 13:43:59.168864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12332): Terminated: ok {rc=0} 13:43:59.215654 --- ParallelTerminationStrategy: PID 12333 died... 13:43:59.235332 run iperf3-srv_10.42.42.10(pid=12333): Terminated {rc=256} 13:43:59.282263 --- ParallelTerminationStrategy: PID 12334 died... 13:43:59.302004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12334): Terminated: ok {rc=0} 13:43:59.348774 --- ParallelTerminationStrategy: PID 12335 died... 13:43:59.368483 run iperf3-srv_10.42.42.10(pid=12335): Terminated {rc=256} 13:43:59.415389 --- ParallelTerminationStrategy: PID 12338 died... 13:43:59.435277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12338): Terminated: ok {rc=0} 13:43:59.482419 --- ParallelTerminationStrategy: PID 12341 died... 13:43:59.502234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12341): Terminated: ok {rc=0} 13:43:59.549162 --- ParallelTerminationStrategy: PID 12344 died... 13:43:59.568868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12344): Terminated: ok {rc=0} 13:43:59.658079 bus /gobi_4: Setting Powered False 13:44:00.758805 bus /gobi_4: Setting Powered False 13:44:01.875283 bus /gobi_1: Setting Powered False 13:44:02.977572 bus /gobi_1: Setting Powered False 13:44:04.092589 bus /gobi_0: Setting Powered False 13:44:05.192616 bus /gobi_0: Setting Powered False 13:44:06.311971 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 13:44:07.414888 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:44:07.426632 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:44:07.473278 tst ping.py: using LAC 21860 13:44:07.591050 tst ping.py: using RAC 185 13:44:07.716673 tst ping.py: using CellId 21860 13:44:07.832879 tst ping.py: using BVCI 21861 13:44:07.939340 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:44:07.950664 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:44:07.961630 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:44:07.972531 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:44:07.983387 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:44:07.994386 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:44:08.005281 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:44:08.015961 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:44:08.131115 tst ping.py:19: start network... 13:44:08.341350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:08.825714 run create_hlr_db(pid=12346): Launched 13:44:08.945173 bus /gobi_6: Setting Powered False 13:44:10.003453 run create_hlr_db(pid=12346): Terminated: ok {rc=0} 13:44:10.420424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12348): Launched 13:44:10.713979 run osmo-hlr_10.42.42.2(pid=12349): Launched 13:44:10.825164 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:11.334202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12351): Launched 13:44:11.627737 run osmo-stp_10.42.42.5(pid=12352): Launched 13:44:11.738809 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:44:12.246559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12354): Launched 13:44:12.358323 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:44:12.605725 run patchelf(pid=12355): Launched 13:44:12.768419 run osmo-stp_10.42.42.5(pid=12352): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12352)] 13:44:12.893387 run osmo-stp_10.42.42.5(pid=12352): stdout: | (launched: 2022-12-09_13:44:11.573410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:13.019509 run osmo-stp_10.42.42.5(pid=12352): stderr: | 20221209134411744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134411744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134411745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134411745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134411746 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134411746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134411746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:13.145690 run osmo-stp_10.42.42.5(pid=12352): stdout: | (launched: 2022-12-09_13:44:11.573410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:13.266189 run osmo-stp_10.42.42.5(pid=12352): stderr: | 20221209134411744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134411744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134411745 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134411745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134411746 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134411746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134411746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:13.409124 run patchelf(pid=12355): Terminating (SIGINT) 13:44:13.573672 run patchelf(pid=12355): Terminated: ok {rc=0} 13:44:13.692471 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12352): Process ended prematurely: osmo-stp_10.42.42.5(pid=12352) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12352)] [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 13:44:13.701662 tst ping.py:22: Test FAILED (6.3 sec) 13:44:13.728318 run osmo-hlr_10.42.42.2(pid=12349): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12349)] 13:44:13.776035 run osmo-hlr_10.42.42.2(pid=12349): stdout: | (launched: 2022-12-09_13:44:10.659597) 13:44:13.825759 run osmo-hlr_10.42.42.2(pid=12349): stderr: | 20221209134410835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134410835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134410835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134410835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134410835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134410835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134410848 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134410858 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134410858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134410858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:13.875748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12348): Terminating (SIGTERM) 13:44:13.915762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12351): Terminating (SIGTERM) 13:44:13.955727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12354): Terminating (SIGTERM) 13:44:13.996005 --- ParallelTerminationStrategy: PID 12348 died... 13:44:14.015249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12348): Terminated: ok {rc=0} 13:44:14.059774 --- ParallelTerminationStrategy: PID 12351 died... 13:44:14.078537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12351): Terminated: ok {rc=0} 13:44:14.123097 --- ParallelTerminationStrategy: PID 12354 died... 13:44:14.141903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12354): Terminated: ok {rc=0} 13:44:14.227638 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:44:15.316290 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:44:15.328050 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:44:15.376120 tst ping_idle_ping.py: using LAC 21861 13:44:15.493428 tst ping_idle_ping.py: using RAC 186 13:44:15.610087 tst ping_idle_ping.py: using CellId 21861 13:44:15.727238 tst ping_idle_ping.py: using BVCI 21862 13:44:15.839380 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:44:15.851901 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:44:15.864512 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:44:15.881802 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:44:15.899360 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:44:15.914195 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:44:15.927824 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:44:15.941381 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:44:16.064799 tst ping_idle_ping.py:24: start network... 13:44:16.327515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:16.806185 run create_hlr_db(pid=12356): Launched 13:44:16.957011 bus /gobi_6: Setting Powered False 13:44:18.016249 run create_hlr_db(pid=12356): Terminated: ok {rc=0} 13:44:18.447289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12358): Launched 13:44:18.760842 run osmo-hlr_10.42.42.2(pid=12359): Launched 13:44:18.881372 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:19.426081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12361): Launched 13:44:19.739684 run osmo-stp_10.42.42.5(pid=12362): Launched 13:44:19.860125 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:44:20.401707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12364): Launched 13:44:20.521388 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:44:20.786386 run patchelf(pid=12365): Launched 13:44:20.959839 run osmo-stp_10.42.42.5(pid=12362): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12362)] 13:44:21.093341 run osmo-stp_10.42.42.5(pid=12362): stdout: | (launched: 2022-12-09_13:44:19.681664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:21.228247 run osmo-stp_10.42.42.5(pid=12362): stderr: | 20221209134419873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134419873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134419873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134419874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134419874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134419874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134419874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:21.363294 run osmo-stp_10.42.42.5(pid=12362): stdout: | (launched: 2022-12-09_13:44:19.681664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:21.492257 run osmo-stp_10.42.42.5(pid=12362): stderr: | 20221209134419873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134419873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134419873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134419874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134419874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134419874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134419874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:21.645930 run patchelf(pid=12365): Terminating (SIGINT) 13:44:21.822017 run patchelf(pid=12365): Terminated: ok {rc=0} 13:44:21.948809 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12362): Process ended prematurely: osmo-stp_10.42.42.5(pid=12362) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12362)] [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 13:44:21.958546 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:44:21.987190 run osmo-hlr_10.42.42.2(pid=12359): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12359)] 13:44:22.037814 run osmo-hlr_10.42.42.2(pid=12359): stdout: | (launched: 2022-12-09_13:44:18.703070) 13:44:22.089921 run osmo-hlr_10.42.42.2(pid=12359): stderr: | 20221209134418897 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134418897 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134418897 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134418897 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134418897 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134418897 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134418909 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134418918 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134418918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134418918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:22.142262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12358): Terminating (SIGTERM) 13:44:22.184192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12361): Terminating (SIGTERM) 13:44:22.226144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12364): Terminating (SIGTERM) 13:44:22.268255 --- ParallelTerminationStrategy: PID 12358 died... 13:44:22.287973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12358): Terminated: ok {rc=0} 13:44:22.334642 --- ParallelTerminationStrategy: PID 12361 died... 13:44:22.354026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12361): Terminated: ok {rc=0} 13:44:22.400214 --- ParallelTerminationStrategy: PID 12364 died... 13:44:22.419637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12364): Terminated: ok {rc=0} 13:44:22.507786 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:44:23.808288 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:44:23.814312 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:44:23.844612 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:44:23.883494 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:44:23.969583 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:44:23.998391 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:44:24.037370 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:44:24.634010 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:44:24.688451 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:24.700199 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:44:24.771209 tst cs_paging_gprs_active.py: using LAC 21862 13:44:24.896639 tst cs_paging_gprs_active.py: using RAC 187 13:44:25.019987 tst cs_paging_gprs_active.py: using CellId 21862 13:44:25.143792 tst cs_paging_gprs_active.py: using BVCI 21863 13:44:25.260102 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:25.271759 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:25.283157 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:25.294801 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:25.306511 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:25.318666 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:25.330561 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:25.342090 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:25.353793 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:44:25.474892 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:44:25.590057 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:44:25.793270 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:26.094763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12369): Launched 13:44:26.355799 run iperf3-srv_10.42.42.10(pid=12370): Launched 13:44:26.468916 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:44:26.670140 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:26.971272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12371): Launched 13:44:27.232308 run iperf3-srv_10.42.42.10(pid=12372): Launched 13:44:27.344299 tst cs_paging_gprs_active.py:38: start network... 13:44:27.545354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:28.010084 run create_hlr_db(pid=12373): Launched 13:44:28.132289 bus /gobi_6: Setting Powered False 13:44:29.192900 run create_hlr_db(pid=12373): Terminated: ok {rc=0} 13:44:29.629987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12375): Launched 13:44:29.951813 run osmo-hlr_10.42.42.2(pid=12376): Launched 13:44:30.074399 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:30.628487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12378): Launched 13:44:30.982033 run osmo-stp_10.42.42.5(pid=12379): Launched 13:44:31.220707 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:44:31.901748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12381): Launched 13:44:32.028478 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:44:32.287682 run patchelf(pid=12382): Launched 13:44:32.454518 run osmo-stp_10.42.42.5(pid=12379): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12379)] 13:44:32.582376 run osmo-stp_10.42.42.5(pid=12379): stdout: | (launched: 2022-12-09_13:44:30.921388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:32.711628 run osmo-stp_10.42.42.5(pid=12379): stderr: | 20221209134431242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134431242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134431242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134431243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134431243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134431243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134431243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:32.840829 run osmo-stp_10.42.42.5(pid=12379): stdout: | (launched: 2022-12-09_13:44:30.921388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:32.963917 run osmo-stp_10.42.42.5(pid=12379): stderr: | 20221209134431242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134431242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134431242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134431243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134431243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134431243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134431243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:33.110101 run patchelf(pid=12382): Terminating (SIGINT) 13:44:33.278055 run patchelf(pid=12382): Terminated: ok {rc=0} 13:44:33.399199 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12379): Process ended prematurely: osmo-stp_10.42.42.5(pid=12379) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12379)] [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:44:33.408760 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:44:33.436095 run osmo-hlr_10.42.42.2(pid=12376): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12376)] 13:44:33.484100 run osmo-hlr_10.42.42.2(pid=12376): stdout: | (launched: 2022-12-09_13:44:29.893065) 13:44:33.533587 run osmo-hlr_10.42.42.2(pid=12376): stderr: | 20221209134430089 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134430089 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134430089 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134430089 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134430090 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134430090 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134430102 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134430110 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134430110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134430110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:33.583457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12369): Terminating (SIGTERM) 13:44:33.623294 run iperf3-srv_10.42.42.10(pid=12370): Terminating (SIGTERM) 13:44:33.662939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12371): Terminating (SIGTERM) 13:44:33.702814 run iperf3-srv_10.42.42.10(pid=12372): Terminating (SIGTERM) 13:44:33.743190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12375): Terminating (SIGTERM) 13:44:33.783024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12378): Terminating (SIGTERM) 13:44:33.822716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12381): Terminating (SIGTERM) 13:44:33.862703 --- ParallelTerminationStrategy: PID 12369 died... 13:44:33.881799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12369): Terminated: ok {rc=0} 13:44:33.925503 --- ParallelTerminationStrategy: PID 12370 died... 13:44:33.944070 run iperf3-srv_10.42.42.10(pid=12370): Terminated {rc=256} 13:44:33.987515 --- ParallelTerminationStrategy: PID 12371 died... 13:44:34.006116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12371): Terminated: ok {rc=0} 13:44:34.049406 --- ParallelTerminationStrategy: PID 12372 died... 13:44:34.067973 run iperf3-srv_10.42.42.10(pid=12372): Terminated {rc=256} 13:44:34.111595 --- ParallelTerminationStrategy: PID 12375 died... 13:44:34.130233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12375): Terminated: ok {rc=0} 13:44:34.173661 --- ParallelTerminationStrategy: PID 12378 died... 13:44:34.192271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12378): Terminated: ok {rc=0} 13:44:34.235609 --- ParallelTerminationStrategy: PID 12381 died... 13:44:34.254224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12381): Terminated: ok {rc=0} 13:44:34.339283 bus /gobi_0: Setting Powered False 13:44:35.439984 bus /gobi_0: Setting Powered False 13:44:36.556015 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:44:37.701495 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:37.713345 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:44:37.784746 tst iperf3.py: using LAC 21863 13:44:37.901680 tst iperf3.py: using RAC 188 13:44:38.018373 tst iperf3.py: using CellId 21863 13:44:38.137068 tst iperf3.py: using BVCI 21864 13:44:38.245444 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:38.256572 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:38.267484 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:38.278470 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:38.289437 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:38.300212 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:38.311083 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:38.321778 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:38.332588 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:44:38.445945 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:44:38.647301 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:38.949356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12383): Launched 13:44:39.211581 run iperf3-srv_10.42.42.10(pid=12384): Launched 13:44:39.324395 tst iperf3.py:8: start network... 13:44:39.524917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:39.991953 run create_hlr_db(pid=12385): Launched 13:44:40.113632 bus /gobi_6: Setting Powered False 13:44:41.173743 run create_hlr_db(pid=12385): Terminated: ok {rc=0} 13:44:41.611145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12387): Launched 13:44:41.931386 run osmo-hlr_10.42.42.2(pid=12388): Launched 13:44:42.053103 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:42.612541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12390): Launched 13:44:42.932423 run osmo-stp_10.42.42.5(pid=12391): Launched 13:44:43.054316 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:44:43.606708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12393): Launched 13:44:43.729308 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:44:43.999769 run patchelf(pid=12394): Launched 13:44:44.177053 run osmo-stp_10.42.42.5(pid=12391): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12391)] 13:44:44.312806 run osmo-stp_10.42.42.5(pid=12391): stdout: | (launched: 2022-12-09_13:44:42.874124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:44.450267 run osmo-stp_10.42.42.5(pid=12391): stderr: | 20221209134443066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134443066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134443066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134443067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134443067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134443067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134443067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:44.587427 run osmo-stp_10.42.42.5(pid=12391): stdout: | (launched: 2022-12-09_13:44:42.874124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:44.719326 run osmo-stp_10.42.42.5(pid=12391): stderr: | 20221209134443066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134443066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134443066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134443067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134443067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134443067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134443067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:44.876024 run patchelf(pid=12394): Terminating (SIGINT) 13:44:45.054556 run patchelf(pid=12394): Terminated: ok {rc=0} 13:44:45.183650 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12391): Process ended prematurely: osmo-stp_10.42.42.5(pid=12391) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12391)] [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 13:44:45.194007 tst iperf3.py:8: Test FAILED (7.5 sec) 13:44:45.223136 run osmo-hlr_10.42.42.2(pid=12388): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12388)] 13:44:45.273840 run osmo-hlr_10.42.42.2(pid=12388): stdout: | (launched: 2022-12-09_13:44:41.873329) 13:44:45.326307 run osmo-hlr_10.42.42.2(pid=12388): stderr: | 20221209134442070 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134442070 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134442070 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134442070 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134442070 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134442070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134442083 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134442094 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134442094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134442094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:45.379557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12383): Terminating (SIGTERM) 13:44:45.421839 run iperf3-srv_10.42.42.10(pid=12384): Terminating (SIGTERM) 13:44:45.464043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12387): Terminating (SIGTERM) 13:44:45.506452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12390): Terminating (SIGTERM) 13:44:45.548750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12393): Terminating (SIGTERM) 13:44:45.591565 --- ParallelTerminationStrategy: PID 12383 died... 13:44:45.611695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12383): Terminated: ok {rc=0} 13:44:45.658944 --- ParallelTerminationStrategy: PID 12384 died... 13:44:45.678632 run iperf3-srv_10.42.42.10(pid=12384): Terminated {rc=256} 13:44:45.725067 --- ParallelTerminationStrategy: PID 12387 died... 13:44:45.744919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12387): Terminated: ok {rc=0} 13:44:45.791657 --- ParallelTerminationStrategy: PID 12390 died... 13:44:45.811347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12390): Terminated: ok {rc=0} 13:44:45.866115 --- ParallelTerminationStrategy: PID 12393 died... 13:44:45.889368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12393): Terminated: ok {rc=0} 13:44:45.991427 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:44:47.158577 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:47.170532 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:44:47.236791 tst iperf3m4.py: using LAC 21864 13:44:47.372919 tst iperf3m4.py: using RAC 189 13:44:47.500506 tst iperf3m4.py: using CellId 21864 13:44:47.626006 tst iperf3m4.py: using BVCI 21865 13:44:47.743197 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:47.755063 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:47.766518 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:47.778130 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:47.789965 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:47.801735 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:47.813732 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:47.825848 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:47.839047 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:44:47.955775 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:44:48.077893 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:44:48.196331 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:44:48.314112 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:44:48.514440 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:48.815342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12396): Launched 13:44:49.076505 run iperf3-srv_10.42.42.10(pid=12397): Launched 13:44:49.189606 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:44:49.389501 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:49.690255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12398): Launched 13:44:49.952445 run iperf3-srv_10.42.42.10(pid=12399): Launched 13:44:50.064820 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:44:50.265266 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:50.565715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12400): Launched 13:44:50.826111 run iperf3-srv_10.42.42.10(pid=12401): Launched 13:44:50.938006 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:44:51.136672 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:51.436687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12402): Launched 13:44:51.696634 run iperf3-srv_10.42.42.10(pid=12403): Launched 13:44:51.808377 tst iperf3m4.py:8: start network... 13:44:52.007202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:52.470171 run create_hlr_db(pid=12404): Launched 13:44:52.595621 bus /gobi_6: Setting Powered False 13:44:53.658441 run create_hlr_db(pid=12404): Terminated: ok {rc=0} 13:44:54.086974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12406): Launched 13:44:54.386515 run osmo-hlr_10.42.42.2(pid=12407): Launched 13:44:54.499124 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:55.020513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12409): Launched 13:44:55.320070 run osmo-stp_10.42.42.5(pid=12410): Launched 13:44:55.434185 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:44:55.952567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12412): Launched 13:44:56.067307 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:44:56.320090 run patchelf(pid=12413): Launched 13:44:56.486601 run osmo-stp_10.42.42.5(pid=12410): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12410)] 13:44:56.613567 run osmo-stp_10.42.42.5(pid=12410): stdout: | (launched: 2022-12-09_13:44:55.264419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:56.741842 run osmo-stp_10.42.42.5(pid=12410): stderr: | 20221209134455433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134455433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134455433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134455433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134455434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134455434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134455434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:56.870322 run osmo-stp_10.42.42.5(pid=12410): stdout: | (launched: 2022-12-09_13:44:55.264419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:56.993342 run osmo-stp_10.42.42.5(pid=12410): stderr: | 20221209134455433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134455433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134455433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134455433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134455434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134455434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134455434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:57.139193 run patchelf(pid=12413): Terminating (SIGINT) 13:44:57.306296 run patchelf(pid=12413): Terminated: ok {rc=0} 13:44:57.426414 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12410): Process ended prematurely: osmo-stp_10.42.42.5(pid=12410) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12410)] [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:44:57.435880 tst iperf3m4.py:8: Test FAILED (10.3 sec) 13:44:57.463115 run osmo-hlr_10.42.42.2(pid=12407): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12407)] 13:44:57.510602 run osmo-hlr_10.42.42.2(pid=12407): stdout: | (launched: 2022-12-09_13:44:54.331115) 13:44:57.560050 run osmo-hlr_10.42.42.2(pid=12407): stderr: | 20221209134454503 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134454503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134454503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134454503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134454503 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134454503 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134454515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134454524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134454525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134454525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:57.610039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12396): Terminating (SIGTERM) 13:44:57.649658 run iperf3-srv_10.42.42.10(pid=12397): Terminating (SIGTERM) 13:44:57.689472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12398): Terminating (SIGTERM) 13:44:57.729325 run iperf3-srv_10.42.42.10(pid=12399): Terminating (SIGTERM) 13:44:57.768815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12400): Terminating (SIGTERM) 13:44:57.808445 run iperf3-srv_10.42.42.10(pid=12401): Terminating (SIGTERM) 13:44:57.847808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12402): Terminating (SIGTERM) 13:44:57.887228 run iperf3-srv_10.42.42.10(pid=12403): Terminating (SIGTERM) 13:44:57.927228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12406): Terminating (SIGTERM) 13:44:57.966855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12409): Terminating (SIGTERM) 13:44:58.006259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12412): Terminating (SIGTERM) 13:44:58.046115 --- ParallelTerminationStrategy: PID 12396 died... 13:44:58.064934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12396): Terminated: ok {rc=0} 13:44:58.108815 --- ParallelTerminationStrategy: PID 12397 died... 13:44:58.127792 run iperf3-srv_10.42.42.10(pid=12397): Terminated {rc=256} 13:44:58.173213 --- ParallelTerminationStrategy: PID 12398 died... 13:44:58.191697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12398): Terminated: ok {rc=0} 13:44:58.235187 --- ParallelTerminationStrategy: PID 12399 died... 13:44:58.253638 run iperf3-srv_10.42.42.10(pid=12399): Terminated {rc=256} 13:44:58.297046 --- ParallelTerminationStrategy: PID 12400 died... 13:44:58.315651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12400): Terminated: ok {rc=0} 13:44:58.359220 --- ParallelTerminationStrategy: PID 12401 died... 13:44:58.377876 run iperf3-srv_10.42.42.10(pid=12401): Terminated {rc=256} 13:44:58.422231 --- ParallelTerminationStrategy: PID 12402 died... 13:44:58.440732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12402): Terminated: ok {rc=0} 13:44:58.484221 --- ParallelTerminationStrategy: PID 12403 died... 13:44:58.502758 run iperf3-srv_10.42.42.10(pid=12403): Terminated {rc=256} 13:44:58.546162 --- ParallelTerminationStrategy: PID 12406 died... 13:44:58.564681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12406): Terminated: ok {rc=0} 13:44:58.608606 --- ParallelTerminationStrategy: PID 12409 died... 13:44:58.627270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12409): Terminated: ok {rc=0} 13:44:58.670627 --- ParallelTerminationStrategy: PID 12412 died... 13:44:58.689185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12412): Terminated: ok {rc=0} 13:44:58.773111 bus /gobi_4: Setting Powered False 13:44:59.873593 bus /gobi_4: Setting Powered False 13:45:00.999179 bus /gobi_1: Setting Powered False 13:45:02.112589 bus /gobi_1: Setting Powered False 13:45:03.239356 bus /gobi_0: Setting Powered False 13:45:04.337893 bus /gobi_0: Setting Powered False 13:45:05.454816 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:45:06.557250 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:45:06.569866 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:45:06.638532 tst ping.py: using LAC 21865 13:45:06.755884 tst ping.py: using RAC 190 13:45:06.880310 tst ping.py: using CellId 21865 13:45:07.003678 tst ping.py: using BVCI 21866 13:45:07.117762 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:45:07.129670 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:45:07.141448 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:45:07.155560 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:45:07.166923 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:45:07.178331 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:45:07.189433 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:45:07.200191 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:45:07.315508 tst ping.py:19: start network... 13:45:07.527639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:08.014550 run create_hlr_db(pid=12418): Launched 13:45:08.134436 bus /gobi_6: Setting Powered False 13:45:09.196500 run create_hlr_db(pid=12418): Terminated: ok {rc=0} 13:45:09.634498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12420): Launched 13:45:09.949436 run osmo-hlr_10.42.42.2(pid=12421): Launched 13:45:10.063276 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:10.574481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12423): Launched 13:45:10.869402 run osmo-stp_10.42.42.5(pid=12424): Launched 13:45:10.980485 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:11.486406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12426): Launched 13:45:11.597729 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:11.845453 run patchelf(pid=12427): Launched 13:45:12.007783 run osmo-stp_10.42.42.5(pid=12424): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12424)] 13:45:12.133165 run osmo-stp_10.42.42.5(pid=12424): stdout: | (launched: 2022-12-09_13:45:10.814644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:12.259165 run osmo-stp_10.42.42.5(pid=12424): stderr: | 20221209134510983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134510983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134510983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134510984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134510984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134510984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134510984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:12.384424 run osmo-stp_10.42.42.5(pid=12424): stdout: | (launched: 2022-12-09_13:45:10.814644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:12.504519 run osmo-stp_10.42.42.5(pid=12424): stderr: | 20221209134510983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134510983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134510983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134510984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134510984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134510984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134510984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:12.646768 run patchelf(pid=12427): Terminating (SIGINT) 13:45:12.810889 run patchelf(pid=12427): Terminated: ok {rc=0} 13:45:12.928833 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12424): Process ended prematurely: osmo-stp_10.42.42.5(pid=12424) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12424)] [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 13:45:12.937780 tst ping.py:22: Test FAILED (6.4 sec) 13:45:12.964445 run osmo-hlr_10.42.42.2(pid=12421): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12421)] 13:45:13.012210 run osmo-hlr_10.42.42.2(pid=12421): stdout: | (launched: 2022-12-09_13:45:09.891722) 13:45:13.061279 run osmo-hlr_10.42.42.2(pid=12421): stderr: | 20221209134510068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134510068 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134510068 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134510068 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134510068 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134510068 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134510080 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134510089 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134510089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134510089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:13.110551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12420): Terminating (SIGTERM) 13:45:13.149933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12423): Terminating (SIGTERM) 13:45:13.189422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12426): Terminating (SIGTERM) 13:45:13.229140 --- ParallelTerminationStrategy: PID 12420 died... 13:45:13.247964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12420): Terminated: ok {rc=0} 13:45:13.291904 --- ParallelTerminationStrategy: PID 12423 died... 13:45:13.310478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12423): Terminated: ok {rc=0} 13:45:13.354010 --- ParallelTerminationStrategy: PID 12426 died... 13:45:13.372381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12426): Terminated: ok {rc=0} 13:45:13.455071 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:45:14.540101 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:45:14.552615 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:45:14.627605 tst ping_idle_ping.py: using LAC 21866 13:45:14.750796 tst ping_idle_ping.py: using RAC 191 13:45:14.866522 tst ping_idle_ping.py: using CellId 21866 13:45:14.981055 tst ping_idle_ping.py: using BVCI 21867 13:45:15.087923 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:45:15.099125 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:45:15.110025 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:45:15.121101 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:45:15.131982 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:45:15.142951 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:45:15.154061 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:45:15.165036 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:45:15.281084 tst ping_idle_ping.py:24: start network... 13:45:15.492819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:15.997694 run create_hlr_db(pid=12428): Launched 13:45:16.159782 bus /gobi_6: Setting Powered False 13:45:17.222070 run create_hlr_db(pid=12428): Terminated: ok {rc=0} 13:45:17.646952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12430): Launched 13:45:17.942325 run osmo-hlr_10.42.42.2(pid=12431): Launched 13:45:18.053832 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:18.562313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12433): Launched 13:45:18.857285 run osmo-stp_10.42.42.5(pid=12434): Launched 13:45:18.968732 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:19.476646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12436): Launched 13:45:19.588916 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:19.837918 run patchelf(pid=12437): Launched 13:45:20.000449 run osmo-stp_10.42.42.5(pid=12434): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12434)] 13:45:20.126041 run osmo-stp_10.42.42.5(pid=12434): stdout: | (launched: 2022-12-09_13:45:18.802249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:20.252292 run osmo-stp_10.42.42.5(pid=12434): stderr: | 20221209134518971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134518971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134518971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134518972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134518972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134518972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134518972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:20.378632 run osmo-stp_10.42.42.5(pid=12434): stdout: | (launched: 2022-12-09_13:45:18.802249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:20.499480 run osmo-stp_10.42.42.5(pid=12434): stderr: | 20221209134518971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134518971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134518971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134518972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134518972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134518972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134518972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:20.641996 run patchelf(pid=12437): Terminating (SIGINT) 13:45:20.806798 run patchelf(pid=12437): Terminated: ok {rc=0} 13:45:20.925572 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12434): Process ended prematurely: osmo-stp_10.42.42.5(pid=12434) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12434)] [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:45:20.934342 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:45:20.960864 run osmo-hlr_10.42.42.2(pid=12431): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12431)] 13:45:21.008622 run osmo-hlr_10.42.42.2(pid=12431): stdout: | (launched: 2022-12-09_13:45:17.887534) 13:45:21.057911 run osmo-hlr_10.42.42.2(pid=12431): stderr: | 20221209134518064 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134518064 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134518064 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134518064 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134518064 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134518064 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134518116 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134518125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134518126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134518126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:21.107722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12430): Terminating (SIGTERM) 13:45:21.147262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12433): Terminating (SIGTERM) 13:45:21.186595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12436): Terminating (SIGTERM) 13:45:21.226480 --- ParallelTerminationStrategy: PID 12430 died... 13:45:21.245599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12430): Terminated: ok {rc=0} 13:45:21.289235 --- ParallelTerminationStrategy: PID 12433 died... 13:45:21.307723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12433): Terminated: ok {rc=0} 13:45:21.351371 --- ParallelTerminationStrategy: PID 12436 died... 13:45:21.369974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12436): Terminated: ok {rc=0} 13:45:21.455235 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:45:22.760299 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:45:22.766557 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:45:22.795654 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:45:22.833929 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:45:22.920222 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:45:22.949244 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:45:22.987306 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:45:23.583400 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:45:23.631424 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:23.642608 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:45:23.708312 tst cs_paging_gprs_active.py: using LAC 21867 13:45:23.827188 tst cs_paging_gprs_active.py: using RAC 192 13:45:23.947048 tst cs_paging_gprs_active.py: using CellId 21867 13:45:24.067411 tst cs_paging_gprs_active.py: using BVCI 21868 13:45:24.178988 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:24.190108 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:24.201013 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:24.211942 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:24.222801 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:24.233622 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:24.244486 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:24.255269 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:24.266384 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:45:24.385350 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:45:24.503201 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:45:24.704504 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:25.006945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12442): Launched 13:45:25.269377 run iperf3-srv_10.42.42.10(pid=12443): Launched 13:45:25.382121 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:45:25.582994 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:25.884718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12444): Launched 13:45:26.147094 run iperf3-srv_10.42.42.10(pid=12445): Launched 13:45:26.259039 tst cs_paging_gprs_active.py:38: start network... 13:45:26.458521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:26.922543 run create_hlr_db(pid=12446): Launched 13:45:27.044733 bus /gobi_6: Setting Powered False 13:45:28.103676 run create_hlr_db(pid=12446): Terminated: ok {rc=0} 13:45:28.521486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12448): Launched 13:45:28.821373 run osmo-hlr_10.42.42.2(pid=12449): Launched 13:45:28.936076 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:29.453166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12451): Launched 13:45:29.754512 run osmo-stp_10.42.42.5(pid=12452): Launched 13:45:29.877926 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:30.437753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12454): Launched 13:45:30.566315 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:30.853762 run patchelf(pid=12455): Launched 13:45:31.039655 run osmo-stp_10.42.42.5(pid=12452): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12452)] 13:45:31.173891 run osmo-stp_10.42.42.5(pid=12452): stdout: | (launched: 2022-12-09_13:45:29.698685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:31.307145 run osmo-stp_10.42.42.5(pid=12452): stderr: | 20221209134529882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134529882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134529882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134529883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134529883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134529883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134529883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:31.440790 run osmo-stp_10.42.42.5(pid=12452): stdout: | (launched: 2022-12-09_13:45:29.698685) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:31.570357 run osmo-stp_10.42.42.5(pid=12452): stderr: | 20221209134529882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134529882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134529882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134529883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134529883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134529883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134529883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:31.722415 run patchelf(pid=12455): Terminating (SIGINT) 13:45:31.897114 run patchelf(pid=12455): Terminated: ok {rc=0} 13:45:32.023277 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12452): Process ended prematurely: osmo-stp_10.42.42.5(pid=12452) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12452)] [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:45:32.033767 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 13:45:32.062890 run osmo-hlr_10.42.42.2(pid=12449): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12449)] 13:45:32.112682 run osmo-hlr_10.42.42.2(pid=12449): stdout: | (launched: 2022-12-09_13:45:28.765849) 13:45:32.164554 run osmo-hlr_10.42.42.2(pid=12449): stderr: | 20221209134528944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134528944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134528944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134528944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134528944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134528944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134528958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134528968 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134528968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134528969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:32.217130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12442): Terminating (SIGTERM) 13:45:32.257513 run iperf3-srv_10.42.42.10(pid=12443): Terminating (SIGTERM) 13:45:32.297682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12444): Terminating (SIGTERM) 13:45:32.337788 run iperf3-srv_10.42.42.10(pid=12445): Terminating (SIGTERM) 13:45:32.378361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12448): Terminating (SIGTERM) 13:45:32.418469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12451): Terminating (SIGTERM) 13:45:32.458718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12454): Terminating (SIGTERM) 13:45:32.499316 --- ParallelTerminationStrategy: PID 12442 died... 13:45:32.518634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12442): Terminated: ok {rc=0} 13:45:32.563259 --- ParallelTerminationStrategy: PID 12443 died... 13:45:32.582246 run iperf3-srv_10.42.42.10(pid=12443): Terminated {rc=256} 13:45:32.626376 --- ParallelTerminationStrategy: PID 12444 died... 13:45:32.645358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12444): Terminated: ok {rc=0} 13:45:32.689713 --- ParallelTerminationStrategy: PID 12445 died... 13:45:32.708591 run iperf3-srv_10.42.42.10(pid=12445): Terminated {rc=256} 13:45:32.752791 --- ParallelTerminationStrategy: PID 12448 died... 13:45:32.771676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12448): Terminated: ok {rc=0} 13:45:32.815993 --- ParallelTerminationStrategy: PID 12451 died... 13:45:32.834972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12451): Terminated: ok {rc=0} 13:45:32.879300 --- ParallelTerminationStrategy: PID 12454 died... 13:45:32.898196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12454): Terminated: ok {rc=0} 13:45:32.993871 bus /gobi_0: Setting Powered False 13:45:34.094985 bus /gobi_0: Setting Powered False 13:45:35.210958 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:45:36.357051 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:36.368731 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:45:36.435307 tst iperf3.py: using LAC 21868 13:45:36.553952 tst iperf3.py: using RAC 193 13:45:36.671661 tst iperf3.py: using CellId 21868 13:45:36.796436 tst iperf3.py: using BVCI 21869 13:45:36.906663 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:36.917724 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:36.928680 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:36.939621 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:36.950456 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:36.961259 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:36.972222 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:36.982965 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:36.993976 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:45:37.113289 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:45:37.329493 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:37.651540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12456): Launched 13:45:37.931900 run iperf3-srv_10.42.42.10(pid=12457): Launched 13:45:38.052458 tst iperf3.py:8: start network... 13:45:38.267637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:38.764798 run create_hlr_db(pid=12458): Launched 13:45:38.887476 bus /gobi_6: Setting Powered False 13:45:39.951779 run create_hlr_db(pid=12458): Terminated: ok {rc=0} 13:45:40.380550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12460): Launched 13:45:40.680306 run osmo-hlr_10.42.42.2(pid=12461): Launched 13:45:40.794816 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:41.314158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12463): Launched 13:45:41.614863 run osmo-stp_10.42.42.5(pid=12464): Launched 13:45:41.729278 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:42.248265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12466): Launched 13:45:42.364267 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:42.617581 run patchelf(pid=12467): Launched 13:45:42.784182 run osmo-stp_10.42.42.5(pid=12464): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12464)] 13:45:42.911399 run osmo-stp_10.42.42.5(pid=12464): stdout: | (launched: 2022-12-09_13:45:41.559010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:43.039965 run osmo-stp_10.42.42.5(pid=12464): stderr: | 20221209134541729 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134541729 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134541729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134541730 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134541730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134541730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134541730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:43.168580 run osmo-stp_10.42.42.5(pid=12464): stdout: | (launched: 2022-12-09_13:45:41.559010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:43.291449 run osmo-stp_10.42.42.5(pid=12464): stderr: | 20221209134541729 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134541729 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134541729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134541730 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134541730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134541730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134541730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:43.437320 run patchelf(pid=12467): Terminating (SIGINT) 13:45:43.605307 run patchelf(pid=12467): Terminated: ok {rc=0} 13:45:43.726364 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12464): Process ended prematurely: osmo-stp_10.42.42.5(pid=12464) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12464)] [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 13:45:43.735835 tst iperf3.py:8: Test FAILED (7.4 sec) 13:45:43.762940 run osmo-hlr_10.42.42.2(pid=12461): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12461)] 13:45:43.810382 run osmo-hlr_10.42.42.2(pid=12461): stdout: | (launched: 2022-12-09_13:45:40.625170) 13:45:43.859846 run osmo-hlr_10.42.42.2(pid=12461): stderr: | 20221209134540803 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134540803 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134540803 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134540803 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134540803 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134540803 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134540814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134540824 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134540824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134540824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:43.909727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12456): Terminating (SIGTERM) 13:45:43.949697 run iperf3-srv_10.42.42.10(pid=12457): Terminating (SIGTERM) 13:45:43.989632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12460): Terminating (SIGTERM) 13:45:44.029444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12463): Terminating (SIGTERM) 13:45:44.069193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12466): Terminating (SIGTERM) 13:45:44.109233 --- ParallelTerminationStrategy: PID 12456 died... 13:45:44.128407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12456): Terminated: ok {rc=0} 13:45:44.172200 --- ParallelTerminationStrategy: PID 12457 died... 13:45:44.190862 run iperf3-srv_10.42.42.10(pid=12457): Terminated {rc=256} 13:45:44.234714 --- ParallelTerminationStrategy: PID 12460 died... 13:45:44.253797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12460): Terminated: ok {rc=0} 13:45:44.298091 --- ParallelTerminationStrategy: PID 12463 died... 13:45:44.316795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12463): Terminated: ok {rc=0} 13:45:44.360436 --- ParallelTerminationStrategy: PID 12466 died... 13:45:44.379384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12466): Terminated: ok {rc=0} 13:45:44.464727 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:45:45.610610 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:45.622276 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:45:45.689396 tst iperf3m4.py: using LAC 21869 13:45:45.806317 tst iperf3m4.py: using RAC 194 13:45:45.952348 tst iperf3m4.py: using CellId 21869 13:45:46.080086 tst iperf3m4.py: using BVCI 21870 13:45:46.203266 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:46.216176 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:46.229200 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:46.243892 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:46.257835 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:46.271509 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:46.285742 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:46.298430 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:46.312028 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:45:46.442463 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:45:46.577269 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:45:46.722007 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:45:46.862482 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:45:47.117387 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:47.443834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12468): Launched 13:45:47.722917 run iperf3-srv_10.42.42.10(pid=12469): Launched 13:45:47.844090 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:45:48.059248 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:48.381347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12470): Launched 13:45:48.660388 run iperf3-srv_10.42.42.10(pid=12471): Launched 13:45:48.781681 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:45:48.997620 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:49.319107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12472): Launched 13:45:49.598589 run iperf3-srv_10.42.42.10(pid=12473): Launched 13:45:49.719213 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:45:49.935111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:50.256720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12474): Launched 13:45:50.534866 run iperf3-srv_10.42.42.10(pid=12475): Launched 13:45:50.654959 tst iperf3m4.py:8: start network... 13:45:50.870608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:51.368126 run create_hlr_db(pid=12476): Launched 13:45:51.490036 bus /gobi_6: Setting Powered False 13:45:52.553537 run create_hlr_db(pid=12476): Terminated: ok {rc=0} 13:45:52.982935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12478): Launched 13:45:53.284676 run osmo-hlr_10.42.42.2(pid=12479): Launched 13:45:53.399408 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:53.917872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12481): Launched 13:45:54.218608 run osmo-stp_10.42.42.5(pid=12482): Launched 13:45:54.332730 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:54.851699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12484): Launched 13:45:54.966042 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:55.219637 run patchelf(pid=12485): Launched 13:45:55.386021 run osmo-stp_10.42.42.5(pid=12482): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12482)] 13:45:55.513283 run osmo-stp_10.42.42.5(pid=12482): stdout: | (launched: 2022-12-09_13:45:54.163122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:55.641998 run osmo-stp_10.42.42.5(pid=12482): stderr: | 20221209134554328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134554328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134554329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134554329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134554330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134554330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134554330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:55.770607 run osmo-stp_10.42.42.5(pid=12482): stdout: | (launched: 2022-12-09_13:45:54.163122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:55.894086 run osmo-stp_10.42.42.5(pid=12482): stderr: | 20221209134554328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134554328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134554329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134554329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134554330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134554330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134554330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:56.040199 run patchelf(pid=12485): Terminating (SIGINT) 13:45:56.207539 run patchelf(pid=12485): Terminated: ok {rc=0} 13:45:56.328389 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12482): Process ended prematurely: osmo-stp_10.42.42.5(pid=12482) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12482)] [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:45:56.338134 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:45:56.365885 run osmo-hlr_10.42.42.2(pid=12479): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12479)] 13:45:56.413733 run osmo-hlr_10.42.42.2(pid=12479): stdout: | (launched: 2022-12-09_13:45:53.228765) 13:45:56.463058 run osmo-hlr_10.42.42.2(pid=12479): stderr: | 20221209134553404 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134553404 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134553404 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134553404 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134553404 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134553404 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134553416 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134553425 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134553425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134553425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:56.512614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12468): Terminating (SIGTERM) 13:45:56.552942 run iperf3-srv_10.42.42.10(pid=12469): Terminating (SIGTERM) 13:45:56.593614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12470): Terminating (SIGTERM) 13:45:56.633301 run iperf3-srv_10.42.42.10(pid=12471): Terminating (SIGTERM) 13:45:56.672836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12472): Terminating (SIGTERM) 13:45:56.712571 run iperf3-srv_10.42.42.10(pid=12473): Terminating (SIGTERM) 13:45:56.752074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12474): Terminating (SIGTERM) 13:45:56.791847 run iperf3-srv_10.42.42.10(pid=12475): Terminating (SIGTERM) 13:45:56.831544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12478): Terminating (SIGTERM) 13:45:56.871285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12481): Terminating (SIGTERM) 13:45:56.910852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12484): Terminating (SIGTERM) 13:45:56.950746 --- ParallelTerminationStrategy: PID 12468 died... 13:45:56.969914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12468): Terminated: ok {rc=0} 13:45:57.014073 --- ParallelTerminationStrategy: PID 12469 died... 13:45:57.032435 run iperf3-srv_10.42.42.10(pid=12469): Terminated {rc=256} 13:45:57.076171 --- ParallelTerminationStrategy: PID 12470 died... 13:45:57.094993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12470): Terminated: ok {rc=0} 13:45:57.139233 --- ParallelTerminationStrategy: PID 12471 died... 13:45:57.157914 run iperf3-srv_10.42.42.10(pid=12471): Terminated {rc=256} 13:45:57.201409 --- ParallelTerminationStrategy: PID 12472 died... 13:45:57.220100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12472): Terminated: ok {rc=0} 13:45:57.263660 --- ParallelTerminationStrategy: PID 12473 died... 13:45:57.282226 run iperf3-srv_10.42.42.10(pid=12473): Terminated {rc=256} 13:45:57.325837 --- ParallelTerminationStrategy: PID 12474 died... 13:45:57.344540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12474): Terminated: ok {rc=0} 13:45:57.388668 --- ParallelTerminationStrategy: PID 12475 died... 13:45:57.407209 run iperf3-srv_10.42.42.10(pid=12475): Terminated {rc=256} 13:45:57.450611 --- ParallelTerminationStrategy: PID 12478 died... 13:45:57.469189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12478): Terminated: ok {rc=0} 13:45:57.512835 --- ParallelTerminationStrategy: PID 12481 died... 13:45:57.531800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12481): Terminated: ok {rc=0} 13:45:57.575931 --- ParallelTerminationStrategy: PID 12484 died... 13:45:57.594664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12484): Terminated: ok {rc=0} 13:45:57.680133 bus /gobi_4: Setting Powered False 13:45:58.778910 bus /gobi_4: Setting Powered False 13:45:59.894627 bus /gobi_1: Setting Powered False 13:46:00.995295 bus /gobi_1: Setting Powered False 13:46:02.121584 bus /gobi_0: Setting Powered False 13:46:03.230031 bus /gobi_0: Setting Powered False 13:46:04.347689 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:46:05.448299 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:46:05.459876 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:46:05.525732 tst ping.py: using LAC 21870 13:46:05.651424 tst ping.py: using RAC 195 13:46:05.774127 tst ping.py: using CellId 21870 13:46:05.896461 tst ping.py: using BVCI 21871 13:46:06.010537 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:46:06.022319 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:46:06.033682 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:46:06.045988 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:46:06.057556 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:46:06.069877 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:46:06.081940 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:46:06.093907 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:46:06.209283 tst ping.py:19: start network... 13:46:06.404664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:06.859421 run create_hlr_db(pid=12486): Launched 13:46:06.978686 bus /gobi_6: Setting Powered False 13:46:08.037846 run create_hlr_db(pid=12486): Terminated: ok {rc=0} 13:46:08.467420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12488): Launched 13:46:08.782878 run osmo-hlr_10.42.42.2(pid=12489): Launched 13:46:08.903050 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:09.448889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12491): Launched 13:46:09.762731 run osmo-stp_10.42.42.5(pid=12492): Launched 13:46:09.884263 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:46:10.426545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12494): Launched 13:46:10.546959 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:46:10.812854 run patchelf(pid=12495): Launched 13:46:10.987752 run osmo-stp_10.42.42.5(pid=12492): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12492)] 13:46:11.121570 run osmo-stp_10.42.42.5(pid=12492): stdout: | (launched: 2022-12-09_13:46:09.705192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:11.256328 run osmo-stp_10.42.42.5(pid=12492): stderr: | 20221209134609894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134609894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134609895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134609895 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134609896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134609896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134609896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:11.391560 run osmo-stp_10.42.42.5(pid=12492): stdout: | (launched: 2022-12-09_13:46:09.705192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:11.520406 run osmo-stp_10.42.42.5(pid=12492): stderr: | 20221209134609894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134609894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134609895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134609895 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134609896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134609896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134609896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:11.674027 run patchelf(pid=12495): Terminating (SIGINT) 13:46:11.850091 run patchelf(pid=12495): Terminated: ok {rc=0} 13:46:11.976613 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12492): Process ended prematurely: osmo-stp_10.42.42.5(pid=12492) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12492)] [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 13:46:11.986452 tst ping.py:22: Test FAILED (6.5 sec) 13:46:12.014884 run osmo-hlr_10.42.42.2(pid=12489): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12489)] 13:46:12.065916 run osmo-hlr_10.42.42.2(pid=12489): stdout: | (launched: 2022-12-09_13:46:08.725308) 13:46:12.118065 run osmo-hlr_10.42.42.2(pid=12489): stderr: | 20221209134608920 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134608920 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134608920 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134608920 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134608920 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134608920 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134608933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134608941 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134608942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134608942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:12.170508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12488): Terminating (SIGTERM) 13:46:12.212512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12491): Terminating (SIGTERM) 13:46:12.254516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12494): Terminating (SIGTERM) 13:46:12.296655 --- ParallelTerminationStrategy: PID 12488 died... 13:46:12.316736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12488): Terminated: ok {rc=0} 13:46:12.363481 --- ParallelTerminationStrategy: PID 12491 died... 13:46:12.383179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12491): Terminated: ok {rc=0} 13:46:12.429576 --- ParallelTerminationStrategy: PID 12494 died... 13:46:12.449264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12494): Terminated: ok {rc=0} 13:46:12.536770 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:46:13.625116 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:46:13.637609 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:46:13.707616 tst ping_idle_ping.py: using LAC 21871 13:46:13.832787 tst ping_idle_ping.py: using RAC 196 13:46:13.955937 tst ping_idle_ping.py: using CellId 21871 13:46:14.078896 tst ping_idle_ping.py: using BVCI 21872 13:46:14.193248 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:46:14.204897 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:46:14.216509 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:46:14.228290 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:46:14.240203 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:46:14.252112 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:46:14.263941 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:46:14.275661 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:46:14.390063 tst ping_idle_ping.py:24: start network... 13:46:14.588668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:15.047895 run create_hlr_db(pid=12496): Launched 13:46:15.169666 bus /gobi_6: Setting Powered False 13:46:16.227957 run create_hlr_db(pid=12496): Terminated: ok {rc=0} 13:46:16.657735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12498): Launched 13:46:16.970639 run osmo-hlr_10.42.42.2(pid=12499): Launched 13:46:17.142883 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:17.719198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12501): Launched 13:46:18.034937 run osmo-stp_10.42.42.5(pid=12502): Launched 13:46:18.154780 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:46:18.699511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12504): Launched 13:46:18.821274 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:46:19.088021 run patchelf(pid=12505): Launched 13:46:19.263486 run osmo-stp_10.42.42.5(pid=12502): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12502)] 13:46:19.397919 run osmo-stp_10.42.42.5(pid=12502): stdout: | (launched: 2022-12-09_13:46:17.977271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:19.533599 run osmo-stp_10.42.42.5(pid=12502): stderr: | 20221209134618167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134618167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134618168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134618168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134618168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134618169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134618169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:19.669336 run osmo-stp_10.42.42.5(pid=12502): stdout: | (launched: 2022-12-09_13:46:17.977271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:19.799408 run osmo-stp_10.42.42.5(pid=12502): stderr: | 20221209134618167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134618167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134618168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134618168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134618168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134618169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134618169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:19.953248 run patchelf(pid=12505): Terminating (SIGINT) 13:46:20.130095 run patchelf(pid=12505): Terminated: ok {rc=0} 13:46:20.256893 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12502): Process ended prematurely: osmo-stp_10.42.42.5(pid=12502) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12502)] [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:46:20.266635 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:46:20.295532 run osmo-hlr_10.42.42.2(pid=12499): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12499)] 13:46:20.346393 run osmo-hlr_10.42.42.2(pid=12499): stdout: | (launched: 2022-12-09_13:46:16.911379) 13:46:20.399042 run osmo-hlr_10.42.42.2(pid=12499): stderr: | 20221209134617217 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134617218 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134617218 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134617218 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134617218 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134617218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134617230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134617238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134617239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134617239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:20.452175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12498): Terminating (SIGTERM) 13:46:20.494509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12501): Terminating (SIGTERM) 13:46:20.536805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12504): Terminating (SIGTERM) 13:46:20.579554 --- ParallelTerminationStrategy: PID 12498 died... 13:46:20.599768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12498): Terminated: ok {rc=0} 13:46:20.647046 --- ParallelTerminationStrategy: PID 12501 died... 13:46:20.666895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12501): Terminated: ok {rc=0} 13:46:20.713516 --- ParallelTerminationStrategy: PID 12504 died... 13:46:20.732932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12504): Terminated: ok {rc=0} 13:46:20.820855 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:46:22.133397 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:46:22.141335 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:46:22.173579 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:46:22.209132 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:46:22.262501 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:46:22.292253 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:46:22.326804 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:46:22.886038 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2360 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:46:22.893535 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:46:22.906048 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:46:22.972379 tst switch_tch_pdch.py: using LAC 21872 13:46:23.093378 tst switch_tch_pdch.py: using RAC 197 13:46:23.217765 tst switch_tch_pdch.py: using CellId 21872 13:46:23.338721 tst switch_tch_pdch.py: using BVCI 21873 13:46:23.452429 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:46:23.464199 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:46:23.476016 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:46:23.487886 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:46:23.499803 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:46:23.511605 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:46:23.523505 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:46:23.535285 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:46:23.650532 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:46:23.765541 tst switch_tch_pdch.py:51: start network... 13:46:23.961524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:24.416320 run create_hlr_db(pid=12509): Launched 13:46:24.538102 bus /gobi_6: Setting Powered False 13:46:25.597413 run create_hlr_db(pid=12509): Terminated: ok {rc=0} 13:46:26.029242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12511): Launched 13:46:26.342763 run osmo-hlr_10.42.42.2(pid=12512): Launched 13:46:26.462655 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:27.006756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12514): Launched 13:46:27.320165 run osmo-stp_10.42.42.5(pid=12515): Launched 13:46:27.439436 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:46:27.982046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12517): Launched 13:46:28.102044 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:46:28.366835 run patchelf(pid=12518): Launched 13:46:28.541892 run osmo-stp_10.42.42.5(pid=12515): ERR: Terminated: ERROR {rc=1} [trial-2360↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12515)] 13:46:28.675581 run osmo-stp_10.42.42.5(pid=12515): stdout: | (launched: 2022-12-09_13:46:27.262587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:28.810899 run osmo-stp_10.42.42.5(pid=12515): stderr: | 20221209134627453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134627453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134627453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134627454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134627454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134627454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134627454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:28.946017 run osmo-stp_10.42.42.5(pid=12515): stdout: | (launched: 2022-12-09_13:46:27.262587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:29.075326 run osmo-stp_10.42.42.5(pid=12515): stderr: | 20221209134627453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134627453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134627453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134627454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134627454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134627454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134627454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:29.227572 run patchelf(pid=12518): Terminating (SIGINT) 13:46:29.402849 run patchelf(pid=12518): Terminated: ok {rc=0} 13:46:29.529288 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12515): Process ended prematurely: osmo-stp_10.42.42.5(pid=12515) [trial-2360↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12515)] [trial-2360↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:46:29.538989 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 13:46:29.567206 run osmo-hlr_10.42.42.2(pid=12512): ERR: Terminated: ERROR {rc=237} [trial-2360↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12512)] 13:46:29.617585 run osmo-hlr_10.42.42.2(pid=12512): stdout: | (launched: 2022-12-09_13:46:26.285150) 13:46:29.669761 run osmo-hlr_10.42.42.2(pid=12512): stderr: | 20221209134626480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134626480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134626480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134626480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134626481 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134626481 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134626493 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134626501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134626501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134626501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:29.722228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12511): Terminating (SIGTERM) 13:46:29.763868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12514): Terminating (SIGTERM) 13:46:29.806075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12517): Terminating (SIGTERM) 13:46:29.848000 --- ParallelTerminationStrategy: PID 12511 died... 13:46:29.868071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12511): Terminated: ok {rc=0} 13:46:29.914514 --- ParallelTerminationStrategy: PID 12514 died... 13:46:29.934297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12514): Terminated: ok {rc=0} 13:46:29.980724 --- ParallelTerminationStrategy: PID 12517 died... 13:46:30.000418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12517): Terminated: ok {rc=0} 13:46:30.087350 bus /gobi_0: Setting Powered False 13:46:31.182486 bus /gobi_0: Setting Powered False 13:46:32.295388 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:46:33.554661 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:46:33.561381 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:46:33.590124 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:46:33.624525 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:46:33.679129 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:46:33.709421 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:46:33.744650 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:46:34.297239 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2360 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:46:34.302359 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:46:34.313640 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:46:34.378914 tst switch_tch_pdch.py: using LAC 21873 13:46:34.493717 tst switch_tch_pdch.py: using RAC 198 13:46:34.611797 tst switch_tch_pdch.py: using CellId 21873 13:46:34.730568 tst switch_tch_pdch.py: using BVCI 21874 13:46:34.838049 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:46:34.849319 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:46:34.860150 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:46:34.871081 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:46:34.881924 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:46:34.892748 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:46:34.903755 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:46:34.914651 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:46:35.027184 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:46:35.144254 tst switch_tch_pdch.py:51: start network... 13:46:35.355624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:35.815664 run create_hlr_db(pid=12522): Launched 13:46:35.936632 bus /gobi_6: Setting Powered False 13:46:36.999114 run create_hlr_db(pid=12522): Terminated: ok {rc=0} 13:46:37.396674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12524): Launched 13:46:37.691526 run osmo-hlr_10.42.42.2(pid=12525): Launched 13:46:37.803881 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:38.286052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12527): Launched 13:46:38.580085 run osmo-stp_10.42.42.5(pid=12528): Launched 13:46:38.692147 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:46:39.176034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12530): Launched 13:46:39.287873 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:46:39.535919 run patchelf(pid=12531): Launched 13:46:39.699396 run osmo-stp_10.42.42.5(pid=12528): ERR: Terminated: ERROR {rc=1} [trial-2360↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12528)] 13:46:39.825272 run osmo-stp_10.42.42.5(pid=12528): stdout: | (launched: 2022-12-09_13:46:38.525650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:39.951730 run osmo-stp_10.42.42.5(pid=12528): stderr: | 20221209134638693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134638693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134638694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134638694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134638694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134638695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134638695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:40.078586 run osmo-stp_10.42.42.5(pid=12528): stdout: | (launched: 2022-12-09_13:46:38.525650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:40.199736 run osmo-stp_10.42.42.5(pid=12528): stderr: | 20221209134638693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134638693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134638694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134638694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134638694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134638695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134638695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:40.343486 run patchelf(pid=12531): Terminating (SIGINT) 13:46:40.508465 run patchelf(pid=12531): Terminated: ok {rc=0} 13:46:40.630216 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12528): Process ended prematurely: osmo-stp_10.42.42.5(pid=12528) [trial-2360↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12528)] [trial-2360↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:46:40.639174 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 13:46:40.665454 run osmo-hlr_10.42.42.2(pid=12525): ERR: Terminated: ERROR {rc=237} [trial-2360↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12525)] 13:46:40.712666 run osmo-hlr_10.42.42.2(pid=12525): stdout: | (launched: 2022-12-09_13:46:37.636912) 13:46:40.762228 run osmo-hlr_10.42.42.2(pid=12525): stderr: | 20221209134637813 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134637813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134637813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134637813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134637813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134637813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134637825 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134637834 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134637834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134637834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:40.811637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12524): Terminating (SIGTERM) 13:46:40.851621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12527): Terminating (SIGTERM) 13:46:40.891337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12530): Terminating (SIGTERM) 13:46:40.931338 --- ParallelTerminationStrategy: PID 12524 died... 13:46:40.950545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12524): Terminated: ok {rc=0} 13:46:40.994691 --- ParallelTerminationStrategy: PID 12527 died... 13:46:41.013528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12527): Terminated: ok {rc=0} 13:46:41.057446 --- ParallelTerminationStrategy: PID 12530 died... 13:46:41.076176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12530): Terminated: ok {rc=0} 13:46:41.159514 bus /gobi_0: Setting Powered False 13:46:42.254526 bus /gobi_0: Setting Powered False 13:46:43.371025 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_sms:nanobts --------------------------------------------------------------------- 13:46:44.623274 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:46:44.627318 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 13:46:44.652420 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 13:46:44.659720 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 13:46:44.713124 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 13:46:44.736694 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 13:46:44.743599 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 13:46:45.282655 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 13:46:45.287856 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 13:46:45.299029 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 13:46:45.337200 tst mo_mt_sms.py: using LAC 21874 13:46:45.461572 tst mo_mt_sms.py: using RAC 199 13:46:45.587445 tst mo_mt_sms.py: using CellId 21874 13:46:45.711169 tst mo_mt_sms.py: using BVCI 21875 13:46:45.818944 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 13:46:45.957998 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 13:46:46.103777 tst mo_mt_sms.py:9: start nitb and bts... 13:46:46.310730 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:46:47.004897 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12535): Launched 13:46:47.360437 run osmo-nitb_10.42.42.2(pid=12536): Launched 13:46:47.534219 run osmo-nitb_10.42.42.2(pid=12536): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12536)] 13:46:47.675531 run osmo-nitb_10.42.42.2(pid=12536): stdout: | (launched: 2022-12-09_13:46:47.302973) 13:46:47.818364 run osmo-nitb_10.42.42.2(pid=12536): stderr: | (launched: 2022-12-09_13:46:47.349888) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:46:47.960894 run osmo-nitb_10.42.42.2(pid=12536): stdout: | (launched: 2022-12-09_13:46:47.302973) 13:46:48.098244 run osmo-nitb_10.42.42.2(pid=12536): stderr: | (launched: 2022-12-09_13:46:47.349888) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12536): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12536) [trial-2360↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12536)] 13:46:48.478817 tst osmo-nitb_10.42.42.2(pid=12536): stdout: | (launched: 2022-12-09_13:46:47.302973) 13:46:48.605613 tst osmo-nitb_10.42.42.2(pid=12536): stderr: | (launched: 2022-12-09_13:46:47.349888) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:46:48.754751 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12536): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12536) [trial-2360↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12536)] [trial-2360↪nitb_sms:nanobts↪mo_mt_sms.py:11] 13:46:48.763636 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 13:46:48.770544 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12535): Terminating (SIGTERM) 13:46:48.982088 --- ParallelTerminationStrategy: PID 12535 died... 13:46:49.003814 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12535): Terminated: ok {rc=0} 13:46:49.091251 bus /sierra_3: Setting Powered False 13:46:50.189475 bus /sierra_3: Setting Powered False 13:46:51.307228 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 sms:nanobts+band-1900 --------------------------------------------------------------------- 13:46:52.493658 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:46:52.498562 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 13:46:52.522384 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 13:46:52.549619 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 13:46:52.601085 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 13:46:52.624708 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 13:46:52.651572 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 13:46:53.199416 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 13:46:53.204601 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:46:53.215492 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:46:53.253117 tst mo_mt_sms.py: using LAC 21875 13:46:53.368451 tst mo_mt_sms.py: using RAC 200 13:46:53.483824 tst mo_mt_sms.py: using CellId 21875 13:46:53.605680 tst mo_mt_sms.py: using BVCI 21876 13:46:53.712732 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:46:53.723510 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:46:53.734050 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:46:53.744757 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:46:53.755478 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:46:53.766225 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 13:46:53.878425 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 13:46:53.991533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:54.447651 run create_hlr_db(pid=12540): Launched 13:46:54.568205 bus /sierra_2: Setting Powered False 13:46:55.627980 run create_hlr_db(pid=12540): Terminated: ok {rc=0} 13:46:56.059295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12542): Launched 13:46:56.374428 run osmo-hlr_10.42.42.2(pid=12543): Launched 13:46:56.494520 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:57.038935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12545): Launched 13:46:57.353220 run osmo-stp_10.42.42.5(pid=12546): Launched 13:46:57.473487 run osmo-msc_10.42.42.6: Starting osmo-msc 13:46:58.044002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12548): Launched 13:46:58.360752 run osmo-msc_10.42.42.6(pid=12549): Launched 13:46:58.537531 run osmo-stp_10.42.42.5(pid=12546): ERR: Terminated: ERROR {rc=1} [trial-2360↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12546)] 13:46:58.671529 run osmo-stp_10.42.42.5(pid=12546): stdout: | (launched: 2022-12-09_13:46:57.295504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:58.806444 run osmo-stp_10.42.42.5(pid=12546): stderr: | 20221209134657486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134657487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134657487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134657487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134657488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134657488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134657488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:58.941069 run osmo-stp_10.42.42.5(pid=12546): stdout: | (launched: 2022-12-09_13:46:57.295504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:59.066647 run osmo-stp_10.42.42.5(pid=12546): stderr: | 20221209134657486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134657487 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134657487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134657487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134657488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134657488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134657488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:59.216907 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12546): Process ended prematurely: osmo-stp_10.42.42.5(pid=12546) [trial-2360↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12546)] [trial-2360↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 13:46:59.226069 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 13:46:59.253626 run osmo-hlr_10.42.42.2(pid=12543): ERR: Terminated: ERROR {rc=237} [trial-2360↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12543)] 13:46:59.304061 run osmo-hlr_10.42.42.2(pid=12543): stdout: | (launched: 2022-12-09_13:46:56.316324) 13:46:59.356415 run osmo-hlr_10.42.42.2(pid=12543): stderr: | 20221209134656512 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134656512 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134656512 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134656512 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134656512 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134656512 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134656524 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134656532 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134656532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134656532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:59.428666 run osmo-msc_10.42.42.6(pid=12549): ERR: Terminated: ERROR {rc=2} [trial-2360↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12549)] 13:46:59.478769 run osmo-msc_10.42.42.6(pid=12549): stdout: | (launched: 2022-12-09_13:46:58.302141) 13:46:59.530480 run osmo-msc_10.42.42.6(pid=12549): stderr: | 20221209134658621 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134658621 DLGLOBAL DEBUG validating counter group 0x7f3476810c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134658621 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134658621 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134658621 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134658622 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134658623 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134658624 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134658624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134658624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:46:59.582986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12542): Terminating (SIGTERM) 13:46:59.625001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12545): Terminating (SIGTERM) 13:46:59.666853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12548): Terminating (SIGTERM) 13:46:59.708711 --- ParallelTerminationStrategy: PID 12542 died... 13:46:59.728735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12542): Terminated: ok {rc=0} 13:46:59.775033 --- ParallelTerminationStrategy: PID 12545 died... 13:46:59.794658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12545): Terminated: ok {rc=0} 13:46:59.841678 --- ParallelTerminationStrategy: PID 12548 died... 13:46:59.861376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12548): Terminated: ok {rc=0} 13:46:59.948480 bus /sierra_3: Setting Powered False 13:47:01.046897 bus /sierra_3: Setting Powered False 13:47:02.167099 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 13:47:03.402077 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:47:03.407100 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 13:47:03.432196 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 13:47:03.439473 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 13:47:03.476277 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 13:47:03.500675 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 13:47:03.507428 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 13:47:04.027528 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2360 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 13:47:04.032924 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 13:47:04.044467 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:47:04.084166 tst assert_extension.py: using LAC 21876 13:47:04.208803 tst assert_extension.py: using RAC 201 13:47:04.331350 tst assert_extension.py: using CellId 21876 13:47:04.454374 tst assert_extension.py: using BVCI 21877 13:47:04.569751 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 13:47:04.681738 tst assert_extension.py:10: start nitb and bts... 13:47:04.877985 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:47:05.482140 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12554): Launched 13:47:05.776620 run osmo-nitb_10.42.42.2(pid=12555): Launched 13:47:05.939626 run osmo-nitb_10.42.42.2(pid=12555): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12555)] 13:47:06.072156 run osmo-nitb_10.42.42.2(pid=12555): stdout: | (launched: 2022-12-09_13:47:05.722282) 13:47:06.206436 run osmo-nitb_10.42.42.2(pid=12555): stderr: | (launched: 2022-12-09_13:47:05.766213) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:47:06.340351 run osmo-nitb_10.42.42.2(pid=12555): stdout: | (launched: 2022-12-09_13:47:05.722282) 13:47:06.468934 run osmo-nitb_10.42.42.2(pid=12555): stderr: | (launched: 2022-12-09_13:47:05.766213) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12555): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12555) [trial-2360↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12555)] 13:47:06.887757 tst osmo-nitb_10.42.42.2(pid=12555): stdout: | (launched: 2022-12-09_13:47:05.722282) 13:47:07.007790 tst osmo-nitb_10.42.42.2(pid=12555): stderr: | (launched: 2022-12-09_13:47:05.766213) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:47:07.147750 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12555): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12555) [trial-2360↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12555)] [trial-2360↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 13:47:07.156328 tst assert_extension.py:12: Test FAILED (3.1 sec) 13:47:07.162797 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12554): Terminating (SIGTERM) 13:47:07.372664 --- ParallelTerminationStrategy: PID 12554 died... 13:47:07.393367 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12554): Terminated: ok {rc=0} 13:47:07.480730 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 ussd:nanobts+band-1900 --------------------------------------------------------------------- 13:47:08.650406 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:47:08.655742 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 13:47:08.681571 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 13:47:08.709704 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 13:47:08.746049 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 13:47:08.770421 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 13:47:08.798607 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 13:47:09.327099 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2360 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 13:47:09.332567 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:47:09.343950 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:47:09.383414 tst assert_extension.py: using LAC 21877 13:47:09.505582 tst assert_extension.py: using RAC 202 13:47:09.629304 tst assert_extension.py: using CellId 21877 13:47:09.753522 tst assert_extension.py: using BVCI 21878 13:47:09.870173 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:47:09.881356 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:47:09.892248 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:47:09.903469 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:47:09.914753 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:47:09.925980 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 13:47:10.041587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:10.529453 run create_hlr_db(pid=12559): Launched 13:47:10.649646 bus /sierra_2: Setting Powered False 13:47:11.712138 run create_hlr_db(pid=12559): Terminated: ok {rc=0} 13:47:12.135158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12561): Launched 13:47:12.429369 run osmo-hlr_10.42.42.2(pid=12562): Launched 13:47:12.542364 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:13.096121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12564): Launched 13:47:13.410747 run osmo-stp_10.42.42.5(pid=12565): Launched 13:47:13.530855 run osmo-msc_10.42.42.6: Starting osmo-msc 13:47:14.098266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12567): Launched 13:47:14.411398 run osmo-msc_10.42.42.6(pid=12568): Launched 13:47:14.586665 run osmo-stp_10.42.42.5(pid=12565): ERR: Terminated: ERROR {rc=1} [trial-2360↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12565)] 13:47:14.719919 run osmo-stp_10.42.42.5(pid=12565): stdout: | (launched: 2022-12-09_13:47:13.353279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:14.854697 run osmo-stp_10.42.42.5(pid=12565): stderr: | 20221209134713542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134713543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134713543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134713543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134713544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134713544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134713544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:14.988401 run osmo-stp_10.42.42.5(pid=12565): stdout: | (launched: 2022-12-09_13:47:13.353279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:15.114631 run osmo-stp_10.42.42.5(pid=12565): stderr: | 20221209134713542 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134713543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134713543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134713543 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134713544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134713544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134713544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:15.264656 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12565): Process ended prematurely: osmo-stp_10.42.42.5(pid=12565) [trial-2360↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12565)] [trial-2360↪ussd:nanobts+band-1900↪assert_extension.py:17] 13:47:15.273676 tst assert_extension.py:17: Test FAILED (5.9 sec) 13:47:15.301634 run osmo-hlr_10.42.42.2(pid=12562): ERR: Terminated: ERROR {rc=237} [trial-2360↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12562)] 13:47:15.352258 run osmo-hlr_10.42.42.2(pid=12562): stdout: | (launched: 2022-12-09_13:47:12.375104) 13:47:15.404551 run osmo-hlr_10.42.42.2(pid=12562): stderr: | 20221209134712548 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134712548 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134712548 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134712548 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134712548 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134712548 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134712561 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134712570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134712570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134712570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:15.477301 run osmo-msc_10.42.42.6(pid=12568): ERR: Terminated: ERROR {rc=2} [trial-2360↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12568)] 13:47:15.527891 run osmo-msc_10.42.42.6(pid=12568): stdout: | (launched: 2022-12-09_13:47:14.353894) 13:47:15.580016 run osmo-msc_10.42.42.6(pid=12568): stderr: | 20221209134714675 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134714675 DLGLOBAL DEBUG validating counter group 0x7f41b4d78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134714675 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134714675 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134714675 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134714675 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134714677 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134714678 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134714678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134714678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:47:15.632723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12561): Terminating (SIGTERM) 13:47:15.674813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12564): Terminating (SIGTERM) 13:47:15.716929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12567): Terminating (SIGTERM) 13:47:15.759327 --- ParallelTerminationStrategy: PID 12561 died... 13:47:15.779505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12561): Terminated: ok {rc=0} 13:47:15.827371 --- ParallelTerminationStrategy: PID 12564 died... 13:47:15.850895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12564): Terminated: ok {rc=0} 13:47:15.901420 --- ParallelTerminationStrategy: PID 12567 died... 13:47:15.921757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12567): Terminated: ok {rc=0} 13:47:16.023282 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:47:17.225378 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:47:17.235142 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:47:17.262284 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:47:17.291481 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:47:17.344454 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:47:17.369335 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:47:17.398695 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:47:17.948180 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:47:17.997537 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:47:18.008797 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:47:18.066259 tst mo_mt_call.py: using LAC 21878 13:47:18.181958 tst mo_mt_call.py: using RAC 203 13:47:18.297637 tst mo_mt_call.py: using CellId 21878 13:47:18.422544 tst mo_mt_call.py: using BVCI 21879 13:47:18.540656 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:47:18.552675 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:47:18.564212 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:47:18.576512 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:47:18.588804 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:47:18.600822 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:47:18.717320 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:47:18.837079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:19.334256 run create_hlr_db(pid=12573): Launched 13:47:19.455851 bus /sierra_2: Setting Powered False 13:47:20.520070 run create_hlr_db(pid=12573): Terminated: ok {rc=0} 13:47:20.949565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12575): Launched 13:47:21.251308 run osmo-hlr_10.42.42.2(pid=12576): Launched 13:47:21.365941 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:21.906337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12578): Launched 13:47:22.206230 run osmo-stp_10.42.42.5(pid=12579): Launched 13:47:22.319927 run osmo-msc_10.42.42.6: Starting osmo-msc 13:47:22.864282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12581): Launched 13:47:23.166049 run osmo-msc_10.42.42.6(pid=12582): Launched 13:47:23.333243 run osmo-stp_10.42.42.5(pid=12579): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12579)] 13:47:23.460322 run osmo-stp_10.42.42.5(pid=12579): stdout: | (launched: 2022-12-09_13:47:22.150838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:23.587363 run osmo-stp_10.42.42.5(pid=12579): stderr: | 20221209134722320 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134722320 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134722320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134722321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134722321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134722321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134722321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:23.712119 run osmo-stp_10.42.42.5(pid=12579): stdout: | (launched: 2022-12-09_13:47:22.150838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:23.832032 run osmo-stp_10.42.42.5(pid=12579): stderr: | 20221209134722320 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134722320 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134722320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134722321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134722321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134722321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134722321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:23.974597 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12579): Process ended prematurely: osmo-stp_10.42.42.5(pid=12579) [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12579)] [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:47:23.983662 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:47:24.009832 run osmo-hlr_10.42.42.2(pid=12576): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12576)] 13:47:24.057260 run osmo-hlr_10.42.42.2(pid=12576): stdout: | (launched: 2022-12-09_13:47:21.196068) 13:47:24.106486 run osmo-hlr_10.42.42.2(pid=12576): stderr: | 20221209134721372 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134721372 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134721372 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134721372 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134721372 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134721372 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134721384 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134721393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134721393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134721393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:24.175187 run osmo-msc_10.42.42.6(pid=12582): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12582)] 13:47:24.222624 run osmo-msc_10.42.42.6(pid=12582): stdout: | (launched: 2022-12-09_13:47:23.110474) 13:47:24.271667 run osmo-msc_10.42.42.6(pid=12582): stderr: | 20221209134723380 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134723380 DLGLOBAL DEBUG validating counter group 0x7f71453b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134723380 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134723380 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134723380 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134723381 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134723382 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134723383 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134723383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134723383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:47:24.320799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12575): Terminating (SIGTERM) 13:47:24.360323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12578): Terminating (SIGTERM) 13:47:24.400038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12581): Terminating (SIGTERM) 13:47:24.439700 --- ParallelTerminationStrategy: PID 12575 died... 13:47:24.458765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12575): Terminated: ok {rc=0} 13:47:24.503415 --- ParallelTerminationStrategy: PID 12578 died... 13:47:24.521866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12578): Terminated: ok {rc=0} 13:47:24.565184 --- ParallelTerminationStrategy: PID 12581 died... 13:47:24.583585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12581): Terminated: ok {rc=0} 13:47:24.668511 bus /sierra_3: Setting Powered False 13:47:25.768115 bus /sierra_3: Setting Powered False 13:47:26.881736 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:47:28.023436 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:47:28.035113 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:47:28.094143 tst mo_mt_call_osmux.py: using LAC 21879 13:47:28.211771 tst mo_mt_call_osmux.py: using RAC 204 13:47:28.329476 tst mo_mt_call_osmux.py: using CellId 21879 13:47:28.457359 tst mo_mt_call_osmux.py: using BVCI 21880 13:47:28.574281 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:47:28.586275 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:47:28.598034 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:47:28.609822 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:47:28.622201 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:47:28.634351 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:47:28.753277 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:47:28.875207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:29.373664 run create_hlr_db(pid=12585): Launched 13:47:29.495074 bus /sierra_2: Setting Powered False 13:47:30.558664 run create_hlr_db(pid=12585): Terminated: ok {rc=0} 13:47:31.012828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12587): Launched 13:47:31.339394 run osmo-hlr_10.42.42.2(pid=12588): Launched 13:47:31.590522 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:32.250485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12590): Launched 13:47:32.571339 run osmo-stp_10.42.42.5(pid=12591): Launched 13:47:32.694307 run osmo-msc_10.42.42.6: Starting osmo-msc 13:47:33.274485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12593): Launched 13:47:33.595789 run osmo-msc_10.42.42.6(pid=12594): Launched 13:47:33.774885 run osmo-stp_10.42.42.5(pid=12591): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12591)] 13:47:33.911227 run osmo-stp_10.42.42.5(pid=12591): stdout: | (launched: 2022-12-09_13:47:32.512675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:34.047782 run osmo-stp_10.42.42.5(pid=12591): stderr: | 20221209134732702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134732702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134732703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134732703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134732703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134732704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134732704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:34.183418 run osmo-stp_10.42.42.5(pid=12591): stdout: | (launched: 2022-12-09_13:47:32.512675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:34.311518 run osmo-stp_10.42.42.5(pid=12591): stderr: | 20221209134732702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134732702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134732703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134732703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134732703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134732704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134732704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:34.464576 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12591): Process ended prematurely: osmo-stp_10.42.42.5(pid=12591) [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12591)] [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:47:34.474516 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 13:47:34.503635 run osmo-hlr_10.42.42.2(pid=12588): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12588)] 13:47:34.554167 run osmo-hlr_10.42.42.2(pid=12588): stdout: | (launched: 2022-12-09_13:47:31.279328) 13:47:34.606351 run osmo-hlr_10.42.42.2(pid=12588): stderr: | 20221209134731585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134731585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134731585 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134731585 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134731585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134731585 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134731603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134731619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134731619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134731619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:34.679136 run osmo-msc_10.42.42.6(pid=12594): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12594)] 13:47:34.729147 run osmo-msc_10.42.42.6(pid=12594): stdout: | (launched: 2022-12-09_13:47:33.536865) 13:47:34.780862 run osmo-msc_10.42.42.6(pid=12594): stderr: | 20221209134733859 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134733860 DLGLOBAL DEBUG validating counter group 0x7f818a7e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134733860 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134733860 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134733860 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134733860 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134733862 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134733862 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134733862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134733862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:47:34.833482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12587): Terminating (SIGTERM) 13:47:34.875518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12590): Terminating (SIGTERM) 13:47:34.917349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12593): Terminating (SIGTERM) 13:47:34.959315 --- ParallelTerminationStrategy: PID 12587 died... 13:47:34.979332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12587): Terminated: ok {rc=0} 13:47:35.025861 --- ParallelTerminationStrategy: PID 12590 died... 13:47:35.045359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12590): Terminated: ok {rc=0} 13:47:35.091744 --- ParallelTerminationStrategy: PID 12593 died... 13:47:35.111462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12593): Terminated: ok {rc=0} 13:47:35.199149 bus /sierra_3: Setting Powered False 13:47:36.298723 bus /sierra_3: Setting Powered False 13:47:37.412557 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:47:38.661105 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:47:38.669301 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:47:38.695382 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:47:38.722693 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:47:38.775707 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:47:38.800243 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:47:38.828545 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:47:39.381272 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:47:39.433271 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:39.445204 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:47:39.506364 tst mo_mt_call.py: using LAC 21880 13:47:39.631326 tst mo_mt_call.py: using RAC 205 13:47:39.757070 tst mo_mt_call.py: using CellId 21880 13:47:39.876603 tst mo_mt_call.py: using BVCI 21881 13:47:39.986959 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:39.998116 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:40.009075 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:40.019960 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:40.030907 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:40.041921 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:47:40.158654 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:47:40.275149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:40.742522 run create_hlr_db(pid=12599): Launched 13:47:40.865165 bus /sierra_2: Setting Powered False 13:47:41.925446 run create_hlr_db(pid=12599): Terminated: ok {rc=0} 13:47:42.362947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12601): Launched 13:47:42.684050 run osmo-hlr_10.42.42.2(pid=12602): Launched 13:47:42.806903 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:43.361949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12604): Launched 13:47:43.682541 run osmo-stp_10.42.42.5(pid=12605): Launched 13:47:43.804209 run osmo-msc_10.42.42.6: Starting osmo-msc 13:47:44.385770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12607): Launched 13:47:44.706814 run osmo-msc_10.42.42.6(pid=12608): Launched 13:47:44.886369 run osmo-stp_10.42.42.5(pid=12605): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12605)] 13:47:45.022007 run osmo-stp_10.42.42.5(pid=12605): stdout: | (launched: 2022-12-09_13:47:43.624059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:45.158157 run osmo-stp_10.42.42.5(pid=12605): stderr: | 20221209134743816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134743816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134743816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134743817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134743817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134743817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134743817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:45.293818 run osmo-stp_10.42.42.5(pid=12605): stdout: | (launched: 2022-12-09_13:47:43.624059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:45.422510 run osmo-stp_10.42.42.5(pid=12605): stderr: | 20221209134743816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134743816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134743816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134743817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134743817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134743817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134743817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:45.576260 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12605): Process ended prematurely: osmo-stp_10.42.42.5(pid=12605) [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12605)] [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:47:45.585943 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:47:45.615416 run osmo-hlr_10.42.42.2(pid=12602): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12602)] 13:47:45.666495 run osmo-hlr_10.42.42.2(pid=12602): stdout: | (launched: 2022-12-09_13:47:42.625494) 13:47:45.719302 run osmo-hlr_10.42.42.2(pid=12602): stderr: | 20221209134742824 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134742824 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134742824 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134742824 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134742824 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134742824 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134742835 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134742843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134742843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134742843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:45.792636 run osmo-msc_10.42.42.6(pid=12608): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12608)] 13:47:45.844741 run osmo-msc_10.42.42.6(pid=12608): stdout: | (launched: 2022-12-09_13:47:44.648167) 13:47:45.900405 run osmo-msc_10.42.42.6(pid=12608): stderr: | 20221209134744970 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134744970 DLGLOBAL DEBUG validating counter group 0x7f67e28e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134744971 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134744971 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134744971 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134744971 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134744973 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134744973 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134744973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134744973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:47:45.958203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12601): Terminating (SIGTERM) 13:47:46.001310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12604): Terminating (SIGTERM) 13:47:46.044790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12607): Terminating (SIGTERM) 13:47:46.089727 --- ParallelTerminationStrategy: PID 12601 died... 13:47:46.110108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12601): Terminated: ok {rc=0} 13:47:46.158617 --- ParallelTerminationStrategy: PID 12604 died... 13:47:46.178813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12604): Terminated: ok {rc=0} 13:47:46.227110 --- ParallelTerminationStrategy: PID 12607 died... 13:47:46.247297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12607): Terminated: ok {rc=0} 13:47:46.337791 bus /sierra_3: Setting Powered False 13:47:47.436608 bus /sierra_3: Setting Powered False 13:47:48.553317 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:47:49.702382 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:49.714864 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:47:49.775975 tst mo_mt_call_osmux.py: using LAC 21881 13:47:49.905241 tst mo_mt_call_osmux.py: using RAC 206 13:47:50.028431 tst mo_mt_call_osmux.py: using CellId 21881 13:47:50.146261 tst mo_mt_call_osmux.py: using BVCI 21882 13:47:50.256503 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:50.267907 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:50.279174 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:50.290358 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:50.301422 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:50.312328 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:47:50.431920 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:47:50.552188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:51.049618 run create_hlr_db(pid=12610): Launched 13:47:51.173225 bus /sierra_2: Setting Powered False 13:47:52.237230 run create_hlr_db(pid=12610): Terminated: ok {rc=0} 13:47:52.665590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12612): Launched 13:47:52.966142 run osmo-hlr_10.42.42.2(pid=12613): Launched 13:47:53.080549 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:53.615529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12615): Launched 13:47:53.914955 run osmo-stp_10.42.42.5(pid=12616): Launched 13:47:54.029035 run osmo-msc_10.42.42.6: Starting osmo-msc 13:47:54.571362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12618): Launched 13:47:54.871100 run osmo-msc_10.42.42.6(pid=12619): Launched 13:47:55.039065 run osmo-stp_10.42.42.5(pid=12616): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12616)] 13:47:55.174609 run osmo-stp_10.42.42.5(pid=12616): stdout: | (launched: 2022-12-09_13:47:53.859618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:55.311525 run osmo-stp_10.42.42.5(pid=12616): stderr: | 20221209134754030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134754030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134754030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134754031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134754031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134754031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134754031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:55.445504 run osmo-stp_10.42.42.5(pid=12616): stdout: | (launched: 2022-12-09_13:47:53.859618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:55.573875 run osmo-stp_10.42.42.5(pid=12616): stderr: | 20221209134754030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134754030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134754030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134754031 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134754031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134754031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134754031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:55.726524 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12616): Process ended prematurely: osmo-stp_10.42.42.5(pid=12616) [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12616)] [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:47:55.736370 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:47:55.764940 run osmo-hlr_10.42.42.2(pid=12613): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12613)] 13:47:55.815248 run osmo-hlr_10.42.42.2(pid=12613): stdout: | (launched: 2022-12-09_13:47:52.911073) 13:47:55.867485 run osmo-hlr_10.42.42.2(pid=12613): stderr: | 20221209134753087 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134753087 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134753087 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134753088 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134753088 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134753088 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134753100 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134753109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134753109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134753109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:55.939639 run osmo-msc_10.42.42.6(pid=12619): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12619)] 13:47:55.989750 run osmo-msc_10.42.42.6(pid=12619): stdout: | (launched: 2022-12-09_13:47:54.815698) 13:47:56.041627 run osmo-msc_10.42.42.6(pid=12619): stderr: | 20221209134755086 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134755086 DLGLOBAL DEBUG validating counter group 0x7fe0287d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134755086 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134755086 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134755086 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134755086 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134755088 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134755088 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134755089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134755089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:47:56.093988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12612): Terminating (SIGTERM) 13:47:56.135788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12615): Terminating (SIGTERM) 13:47:56.177983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12618): Terminating (SIGTERM) 13:47:56.220117 --- ParallelTerminationStrategy: PID 12612 died... 13:47:56.240127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12612): Terminated: ok {rc=0} 13:47:56.286967 --- ParallelTerminationStrategy: PID 12615 died... 13:47:56.306663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12615): Terminated: ok {rc=0} 13:47:56.353058 --- ParallelTerminationStrategy: PID 12618 died... 13:47:56.372479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12618): Terminated: ok {rc=0} 13:47:56.460226 bus /sierra_3: Setting Powered False 13:47:57.559898 bus /sierra_3: Setting Powered False 13:47:58.676070 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:47:59.914304 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:47:59.921451 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:47:59.944904 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:47:59.971810 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:48:00.022854 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:48:00.046455 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:48:00.072730 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:48:00.628053 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:48:00.675676 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:48:00.686891 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:48:00.747909 tst mo_mt_call.py: using LAC 21882 13:48:00.871370 tst mo_mt_call.py: using RAC 207 13:48:00.999204 tst mo_mt_call.py: using CellId 21882 13:48:01.130342 tst mo_mt_call.py: using BVCI 21883 13:48:01.253422 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:48:01.266383 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:48:01.279916 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:48:01.293757 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:48:01.307497 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:48:01.320198 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:48:01.452030 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:48:01.592003 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:02.067423 run create_hlr_db(pid=12624): Launched 13:48:02.220666 bus /sierra_2: Setting Powered False 13:48:03.280702 run create_hlr_db(pid=12624): Terminated: ok {rc=0} 13:48:03.698529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12626): Launched 13:48:03.997376 run osmo-hlr_10.42.42.2(pid=12627): Launched 13:48:04.110590 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:04.625320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12629): Launched 13:48:04.925876 run osmo-stp_10.42.42.5(pid=12630): Launched 13:48:05.039811 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:05.582905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12632): Launched 13:48:05.883959 run osmo-msc_10.42.42.6(pid=12633): Launched 13:48:06.052183 run osmo-stp_10.42.42.5(pid=12630): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12630)] 13:48:06.179440 run osmo-stp_10.42.42.5(pid=12630): stdout: | (launched: 2022-12-09_13:48:04.870327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:06.306562 run osmo-stp_10.42.42.5(pid=12630): stderr: | 20221209134805040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134805040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134805041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134805041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134805042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134805042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134805042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:06.431726 run osmo-stp_10.42.42.5(pid=12630): stdout: | (launched: 2022-12-09_13:48:04.870327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:06.551193 run osmo-stp_10.42.42.5(pid=12630): stderr: | 20221209134805040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134805040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134805041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134805041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134805042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134805042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134805042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:06.694682 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12630): Process ended prematurely: osmo-stp_10.42.42.5(pid=12630) [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12630)] [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:48:06.703395 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:48:06.729807 run osmo-hlr_10.42.42.2(pid=12627): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12627)] 13:48:06.777133 run osmo-hlr_10.42.42.2(pid=12627): stdout: | (launched: 2022-12-09_13:48:03.942116) 13:48:06.826241 run osmo-hlr_10.42.42.2(pid=12627): stderr: | 20221209134804117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134804117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134804118 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134804118 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134804118 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134804118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134804135 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134804144 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134804145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134804145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:06.894875 run osmo-msc_10.42.42.6(pid=12633): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12633)] 13:48:06.942191 run osmo-msc_10.42.42.6(pid=12633): stdout: | (launched: 2022-12-09_13:48:05.828438) 13:48:06.991153 run osmo-msc_10.42.42.6(pid=12633): stderr: | 20221209134806100 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134806100 DLGLOBAL DEBUG validating counter group 0x7efe8e382c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134806100 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134806100 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134806100 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134806100 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134806103 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134806104 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134806104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134806104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:07.040453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12626): Terminating (SIGTERM) 13:48:07.079976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12629): Terminating (SIGTERM) 13:48:07.119408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12632): Terminating (SIGTERM) 13:48:07.159087 --- ParallelTerminationStrategy: PID 12626 died... 13:48:07.178129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12626): Terminated: ok {rc=0} 13:48:07.222187 --- ParallelTerminationStrategy: PID 12629 died... 13:48:07.240558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12629): Terminated: ok {rc=0} 13:48:07.284140 --- ParallelTerminationStrategy: PID 12632 died... 13:48:07.302647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12632): Terminated: ok {rc=0} 13:48:07.387590 bus /sierra_3: Setting Powered False 13:48:08.487058 bus /sierra_3: Setting Powered False 13:48:09.602189 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:48:10.747716 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:48:10.759712 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:48:10.819660 tst mo_mt_call_osmux.py: using LAC 21883 13:48:10.939344 tst mo_mt_call_osmux.py: using RAC 208 13:48:11.059767 tst mo_mt_call_osmux.py: using CellId 21883 13:48:11.180311 tst mo_mt_call_osmux.py: using BVCI 21884 13:48:11.290250 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:48:11.301544 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:48:11.312475 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:48:11.323426 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:48:11.334503 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:48:11.345481 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:48:11.462879 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:48:11.579380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:12.045424 run create_hlr_db(pid=12635): Launched 13:48:12.167780 bus /sierra_2: Setting Powered False 13:48:13.228841 run create_hlr_db(pid=12635): Terminated: ok {rc=0} 13:48:13.667643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12637): Launched 13:48:13.989843 run osmo-hlr_10.42.42.2(pid=12638): Launched 13:48:14.111709 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:14.631597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12640): Launched 13:48:14.931907 run osmo-stp_10.42.42.5(pid=12641): Launched 13:48:15.045470 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:15.593721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12643): Launched 13:48:15.901729 run osmo-msc_10.42.42.6(pid=12644): Launched 13:48:16.098932 run osmo-stp_10.42.42.5(pid=12641): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12641)] 13:48:16.373523 run osmo-stp_10.42.42.5(pid=12641): stdout: | (launched: 2022-12-09_13:48:14.875834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:16.642811 run osmo-stp_10.42.42.5(pid=12641): stderr: | 20221209134815048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134815048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134815048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134815049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134815049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134815049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134815049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:16.796618 run osmo-stp_10.42.42.5(pid=12641): stdout: | (launched: 2022-12-09_13:48:14.875834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:16.942672 run osmo-stp_10.42.42.5(pid=12641): stderr: | 20221209134815048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134815048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134815048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134815049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134815049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134815049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134815049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:17.108609 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12641): Process ended prematurely: osmo-stp_10.42.42.5(pid=12641) [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12641)] [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:48:17.118745 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:48:17.148270 run osmo-hlr_10.42.42.2(pid=12638): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12638)] 13:48:17.202885 run osmo-hlr_10.42.42.2(pid=12638): stdout: | (launched: 2022-12-09_13:48:13.931240) 13:48:17.264582 run osmo-hlr_10.42.42.2(pid=12638): stderr: | 20221209134814129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134814129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134814129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134814129 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134814129 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134814129 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134814142 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134814150 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134814150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134814150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:17.348742 run osmo-msc_10.42.42.6(pid=12644): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12644)] 13:48:17.403140 run osmo-msc_10.42.42.6(pid=12644): stdout: | (launched: 2022-12-09_13:48:15.838852) 13:48:17.457570 run osmo-msc_10.42.42.6(pid=12644): stderr: | 20221209134816416 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134816416 DLGLOBAL DEBUG validating counter group 0x7f1ad41eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134816416 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134816416 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134816416 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134816417 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134816418 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134816419 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134816419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134816419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:17.509307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12637): Terminating (SIGTERM) 13:48:17.549314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12640): Terminating (SIGTERM) 13:48:17.589254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12643): Terminating (SIGTERM) 13:48:17.628876 --- ParallelTerminationStrategy: PID 12637 died... 13:48:17.648114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12637): Terminated: ok {rc=0} 13:48:17.691831 --- ParallelTerminationStrategy: PID 12640 died... 13:48:17.710411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12640): Terminated: ok {rc=0} 13:48:17.753924 --- ParallelTerminationStrategy: PID 12643 died... 13:48:17.772436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12643): Terminated: ok {rc=0} 13:48:17.857042 bus /sierra_3: Setting Powered False 13:48:18.951402 bus /sierra_3: Setting Powered False 13:48:20.065441 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:48:21.308222 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:48:21.315295 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:48:21.338977 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:48:21.365605 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:48:21.418314 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:48:21.444659 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:48:21.472181 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:48:22.018857 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:48:22.066832 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:22.078304 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:48:22.137628 tst mo_mt_call.py: using LAC 21884 13:48:22.258393 tst mo_mt_call.py: using RAC 209 13:48:22.375638 tst mo_mt_call.py: using CellId 21884 13:48:22.491730 tst mo_mt_call.py: using BVCI 21885 13:48:22.600346 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:22.611512 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:22.622530 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:22.633520 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:22.644408 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:22.655331 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:48:22.774674 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:48:22.890158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:23.356924 run create_hlr_db(pid=12650): Launched 13:48:23.479580 bus /sierra_2: Setting Powered False 13:48:24.539104 run create_hlr_db(pid=12650): Terminated: ok {rc=0} 13:48:24.977622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12652): Launched 13:48:25.298666 run osmo-hlr_10.42.42.2(pid=12653): Launched 13:48:25.422233 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:25.975922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12655): Launched 13:48:26.296711 run osmo-stp_10.42.42.5(pid=12656): Launched 13:48:26.419663 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:27.001242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12658): Launched 13:48:27.322050 run osmo-msc_10.42.42.6(pid=12659): Launched 13:48:27.502269 run osmo-stp_10.42.42.5(pid=12656): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12656)] 13:48:27.642736 run osmo-stp_10.42.42.5(pid=12656): stdout: | (launched: 2022-12-09_13:48:26.238328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:27.780919 run osmo-stp_10.42.42.5(pid=12656): stderr: | 20221209134826433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134826433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134826433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134826433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134826434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134826434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134826434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:27.917192 run osmo-stp_10.42.42.5(pid=12656): stdout: | (launched: 2022-12-09_13:48:26.238328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:28.045383 run osmo-stp_10.42.42.5(pid=12656): stderr: | 20221209134826433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134826433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134826433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134826433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134826434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134826434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134826434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:28.198659 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12656): Process ended prematurely: osmo-stp_10.42.42.5(pid=12656) [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12656)] [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:48:28.208371 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:48:28.236501 run osmo-hlr_10.42.42.2(pid=12653): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12653)] 13:48:28.287151 run osmo-hlr_10.42.42.2(pid=12653): stdout: | (launched: 2022-12-09_13:48:25.240255) 13:48:28.339335 run osmo-hlr_10.42.42.2(pid=12653): stderr: | 20221209134825440 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134825440 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134825440 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134825440 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134825440 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134825440 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134825452 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134825461 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134825461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134825461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:28.412182 run osmo-msc_10.42.42.6(pid=12659): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12659)] 13:48:28.462490 run osmo-msc_10.42.42.6(pid=12659): stdout: | (launched: 2022-12-09_13:48:27.263123) 13:48:28.514322 run osmo-msc_10.42.42.6(pid=12659): stderr: | 20221209134827587 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134827588 DLGLOBAL DEBUG validating counter group 0x7ff46acc2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134827588 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134827588 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134827588 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134827588 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134827590 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134827590 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134827591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134827591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:28.566728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12652): Terminating (SIGTERM) 13:48:28.608606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12655): Terminating (SIGTERM) 13:48:28.650573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12658): Terminating (SIGTERM) 13:48:28.692732 --- ParallelTerminationStrategy: PID 12652 died... 13:48:28.712780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12652): Terminated: ok {rc=0} 13:48:28.759691 --- ParallelTerminationStrategy: PID 12655 died... 13:48:28.779312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12655): Terminated: ok {rc=0} 13:48:28.825857 --- ParallelTerminationStrategy: PID 12658 died... 13:48:28.845474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12658): Terminated: ok {rc=0} 13:48:28.934248 bus /sierra_3: Setting Powered False 13:48:30.032276 bus /sierra_3: Setting Powered False 13:48:31.156319 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:48:32.312712 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:32.324885 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:48:32.391016 tst mo_mt_call_osmux.py: using LAC 21885 13:48:32.516867 tst mo_mt_call_osmux.py: using RAC 210 13:48:32.641212 tst mo_mt_call_osmux.py: using CellId 21885 13:48:32.765295 tst mo_mt_call_osmux.py: using BVCI 21886 13:48:32.882299 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:32.894148 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:32.905764 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:32.917511 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:32.929411 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:32.941138 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:48:33.060713 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:48:33.177310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:33.644274 run create_hlr_db(pid=12662): Launched 13:48:33.769153 bus /sierra_2: Setting Powered False 13:48:34.829499 run create_hlr_db(pid=12662): Terminated: ok {rc=0} 13:48:35.247549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12664): Launched 13:48:35.547808 run osmo-hlr_10.42.42.2(pid=12665): Launched 13:48:35.662707 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:36.179737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12667): Launched 13:48:36.479607 run osmo-stp_10.42.42.5(pid=12668): Launched 13:48:36.594504 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:37.138761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12670): Launched 13:48:37.440917 run osmo-msc_10.42.42.6(pid=12671): Launched 13:48:37.610245 run osmo-stp_10.42.42.5(pid=12668): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12668)] 13:48:37.740499 run osmo-stp_10.42.42.5(pid=12668): stdout: | (launched: 2022-12-09_13:48:36.424299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:37.869690 run osmo-stp_10.42.42.5(pid=12668): stderr: | 20221209134836596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134836596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134836596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134836597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134836597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134836597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134836597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:37.995306 run osmo-stp_10.42.42.5(pid=12668): stdout: | (launched: 2022-12-09_13:48:36.424299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:38.115459 run osmo-stp_10.42.42.5(pid=12668): stderr: | 20221209134836596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134836596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134836596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134836597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134836597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134836597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134836597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:38.258988 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12668): Process ended prematurely: osmo-stp_10.42.42.5(pid=12668) [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12668)] [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:48:38.267996 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:48:38.294391 run osmo-hlr_10.42.42.2(pid=12665): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12665)] 13:48:38.342274 run osmo-hlr_10.42.42.2(pid=12665): stdout: | (launched: 2022-12-09_13:48:35.492594) 13:48:38.391544 run osmo-hlr_10.42.42.2(pid=12665): stderr: | 20221209134835673 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134835673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134835673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134835673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134835673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134835673 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134835685 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134835694 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134835694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134835694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:38.460191 run osmo-msc_10.42.42.6(pid=12671): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12671)] 13:48:38.507456 run osmo-msc_10.42.42.6(pid=12671): stdout: | (launched: 2022-12-09_13:48:37.385127) 13:48:38.556482 run osmo-msc_10.42.42.6(pid=12671): stderr: | 20221209134837658 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134837658 DLGLOBAL DEBUG validating counter group 0x7f680b322c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134837658 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134837658 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134837658 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134837659 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134837660 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134837661 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134837661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134837661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:38.605921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12664): Terminating (SIGTERM) 13:48:38.645483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12667): Terminating (SIGTERM) 13:48:38.685242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12670): Terminating (SIGTERM) 13:48:38.725073 --- ParallelTerminationStrategy: PID 12664 died... 13:48:38.744180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12664): Terminated: ok {rc=0} 13:48:38.788138 --- ParallelTerminationStrategy: PID 12667 died... 13:48:38.806973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12667): Terminated: ok {rc=0} 13:48:38.850841 --- ParallelTerminationStrategy: PID 12670 died... 13:48:38.869666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12670): Terminated: ok {rc=0} 13:48:38.953128 bus /sierra_3: Setting Powered False 13:48:40.049605 bus /sierra_3: Setting Powered False 13:48:41.165925 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:48:42.404774 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:48:42.411989 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:48:42.435817 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:48:42.462667 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:48:42.515186 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:48:42.539169 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:48:42.565293 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:48:43.116350 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:48:43.164264 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:43.175494 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:48:43.235628 tst mo_mt_call.py: using LAC 21886 13:48:43.354536 tst mo_mt_call.py: using RAC 211 13:48:43.473487 tst mo_mt_call.py: using CellId 21886 13:48:43.591685 tst mo_mt_call.py: using BVCI 21887 13:48:43.703432 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:43.714946 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:43.726043 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:43.737073 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:43.748158 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:43.759299 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:48:43.871304 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:48:43.988406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:44.455571 run create_hlr_db(pid=12676): Launched 13:48:44.578755 bus /sierra_2: Setting Powered False 13:48:45.639118 run create_hlr_db(pid=12676): Terminated: ok {rc=0} 13:48:46.073071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12678): Launched 13:48:46.395887 run osmo-hlr_10.42.42.2(pid=12679): Launched 13:48:46.687237 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:47.318537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12681): Launched 13:48:47.657940 run osmo-stp_10.42.42.5(pid=12682): Launched 13:48:47.782658 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:48.369474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12684): Launched 13:48:48.691728 run osmo-msc_10.42.42.6(pid=12685): Launched 13:48:48.871569 run osmo-stp_10.42.42.5(pid=12682): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12682)] 13:48:49.008491 run osmo-stp_10.42.42.5(pid=12682): stdout: | (launched: 2022-12-09_13:48:47.599335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:49.145310 run osmo-stp_10.42.42.5(pid=12682): stderr: | 20221209134847790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134847790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134847791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134847791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134847791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134847792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134847792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:49.280839 run osmo-stp_10.42.42.5(pid=12682): stdout: | (launched: 2022-12-09_13:48:47.599335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:49.409360 run osmo-stp_10.42.42.5(pid=12682): stderr: | 20221209134847790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134847790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134847791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134847791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134847791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134847792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134847792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:49.562772 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12682): Process ended prematurely: osmo-stp_10.42.42.5(pid=12682) [trial-2360↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12682)] [trial-2360↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:48:49.572525 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:48:49.601092 run osmo-hlr_10.42.42.2(pid=12679): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12679)] 13:48:49.651706 run osmo-hlr_10.42.42.2(pid=12679): stdout: | (launched: 2022-12-09_13:48:46.337776) 13:48:49.703988 run osmo-hlr_10.42.42.2(pid=12679): stderr: | 20221209134846686 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134846686 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134846686 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134846686 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134846686 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134846686 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134846712 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134846720 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134846720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134846720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:49.777277 run osmo-msc_10.42.42.6(pid=12685): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12685)] 13:48:49.827701 run osmo-msc_10.42.42.6(pid=12685): stdout: | (launched: 2022-12-09_13:48:48.632559) 13:48:49.880217 run osmo-msc_10.42.42.6(pid=12685): stderr: | 20221209134848953 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134848954 DLGLOBAL DEBUG validating counter group 0x7f12c8993c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134848954 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134848954 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134848954 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134848954 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134848956 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134848956 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134848956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134848956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:49.932695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12678): Terminating (SIGTERM) 13:48:49.974916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12681): Terminating (SIGTERM) 13:48:50.017639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12684): Terminating (SIGTERM) 13:48:50.060278 --- ParallelTerminationStrategy: PID 12678 died... 13:48:50.080318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12678): Terminated: ok {rc=0} 13:48:50.127339 --- ParallelTerminationStrategy: PID 12681 died... 13:48:50.147094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12681): Terminated: ok {rc=0} 13:48:50.193480 --- ParallelTerminationStrategy: PID 12684 died... 13:48:50.213177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12684): Terminated: ok {rc=0} 13:48:50.301138 bus /sierra_3: Setting Powered False 13:48:51.399823 bus /sierra_3: Setting Powered False 13:48:52.517227 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:48:53.659790 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:53.671803 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:48:53.731590 tst mo_mt_call_osmux.py: using LAC 21887 13:48:53.851576 tst mo_mt_call_osmux.py: using RAC 212 13:48:53.974334 tst mo_mt_call_osmux.py: using CellId 21887 13:48:54.092306 tst mo_mt_call_osmux.py: using BVCI 21888 13:48:54.201416 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:54.212584 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:54.223562 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:54.234668 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:54.245785 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:54.256765 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:48:54.371630 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:48:54.491147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:54.990288 run create_hlr_db(pid=12687): Launched 13:48:55.112831 bus /sierra_2: Setting Powered False 13:48:56.176498 run create_hlr_db(pid=12687): Terminated: ok {rc=0} 13:48:56.621892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12689): Launched 13:48:56.943484 run osmo-hlr_10.42.42.2(pid=12690): Launched 13:48:57.065701 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:57.621527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12692): Launched 13:48:57.942292 run osmo-stp_10.42.42.5(pid=12693): Launched 13:48:58.065209 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:58.647658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12695): Launched 13:48:58.969326 run osmo-msc_10.42.42.6(pid=12696): Launched 13:48:59.149120 run osmo-stp_10.42.42.5(pid=12693): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12693)] 13:48:59.285058 run osmo-stp_10.42.42.5(pid=12693): stdout: | (launched: 2022-12-09_13:48:57.883623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:59.421670 run osmo-stp_10.42.42.5(pid=12693): stderr: | 20221209134858074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134858074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134858075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134858075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134858076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134858076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134858076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:59.556872 run osmo-stp_10.42.42.5(pid=12693): stdout: | (launched: 2022-12-09_13:48:57.883623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:59.685135 run osmo-stp_10.42.42.5(pid=12693): stderr: | 20221209134858074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134858074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134858075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134858075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134858076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134858076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134858076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:59.838499 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12693): Process ended prematurely: osmo-stp_10.42.42.5(pid=12693) [trial-2360↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12693)] [trial-2360↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:48:59.848320 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:48:59.877507 run osmo-hlr_10.42.42.2(pid=12690): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12690)] 13:48:59.927841 run osmo-hlr_10.42.42.2(pid=12690): stdout: | (launched: 2022-12-09_13:48:56.884377) 13:48:59.979909 run osmo-hlr_10.42.42.2(pid=12690): stderr: | 20221209134857082 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134857082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134857082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134857083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134857083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134857083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134857094 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134857102 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134857102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134857102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:00.052472 run osmo-msc_10.42.42.6(pid=12696): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12696)] 13:49:00.102521 run osmo-msc_10.42.42.6(pid=12696): stdout: | (launched: 2022-12-09_13:48:58.910349) 13:49:00.154202 run osmo-msc_10.42.42.6(pid=12696): stderr: | 20221209134859230 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134859230 DLGLOBAL DEBUG validating counter group 0x7efd87553c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134859231 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134859231 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134859231 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134859231 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134859233 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134859233 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134859233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134859233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:49:00.206376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12689): Terminating (SIGTERM) 13:49:00.248286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12692): Terminating (SIGTERM) 13:49:00.290384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12695): Terminating (SIGTERM) 13:49:00.332733 --- ParallelTerminationStrategy: PID 12689 died... 13:49:00.352824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12689): Terminated: ok {rc=0} 13:49:00.399692 --- ParallelTerminationStrategy: PID 12692 died... 13:49:00.419350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12692): Terminated: ok {rc=0} 13:49:00.465702 --- ParallelTerminationStrategy: PID 12695 died... 13:49:00.485440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12695): Terminated: ok {rc=0} 13:49:00.573812 bus /sierra_3: Setting Powered False 13:49:01.669700 bus /sierra_3: Setting Powered False 13:49:02.783530 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 emergency:nanobts+band-1900 --------------------------------------------------------------------- 13:49:04.024351 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:49:04.029545 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 13:49:04.053431 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 13:49:04.080731 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 13:49:04.164786 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 13:49:04.189054 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 13:49:04.215756 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 13:49:04.799237 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2360 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 13:49:04.804704 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:49:04.815752 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:49:04.855042 tst emergency_mo_mt_call.py: using LAC 21888 13:49:04.973217 tst emergency_mo_mt_call.py: using RAC 213 13:49:05.089882 tst emergency_mo_mt_call.py: using CellId 21888 13:49:05.208557 tst emergency_mo_mt_call.py: using BVCI 21889 13:49:05.315828 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:49:05.326812 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:49:05.337413 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:49:05.348097 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:49:05.358815 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:49:05.369770 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:49:05.488097 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:49:05.605096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:06.095387 run create_hlr_db(pid=12701): Launched 13:49:06.216571 bus /sierra_2: Setting Powered False 13:49:07.279494 run create_hlr_db(pid=12701): Terminated: ok {rc=0} 13:49:07.704027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12703): Launched 13:49:08.000457 run osmo-hlr_10.42.42.2(pid=12704): Launched 13:49:08.112384 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:08.621305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12706): Launched 13:49:08.915447 run osmo-stp_10.42.42.5(pid=12707): Launched 13:49:09.040837 tst emergency_mo_mt_call.py: using MSISDN 7236 13:49:09.190802 run osmo-msc_10.42.42.6: Starting osmo-msc 13:49:09.721972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12709): Launched 13:49:10.017981 run osmo-msc_10.42.42.6(pid=12710): Launched 13:49:10.182455 run osmo-stp_10.42.42.5(pid=12707): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12707)] 13:49:10.306653 run osmo-stp_10.42.42.5(pid=12707): stdout: | (launched: 2022-12-09_13:49:08.860910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:10.431561 run osmo-stp_10.42.42.5(pid=12707): stderr: | 20221209134909032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134909032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134909032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134909033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134909033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134909033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134909033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:10.555051 run osmo-stp_10.42.42.5(pid=12707): stdout: | (launched: 2022-12-09_13:49:08.860910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:10.672448 run osmo-stp_10.42.42.5(pid=12707): stderr: | 20221209134909032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134909032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134909032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134909033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134909033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134909033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134909033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:10.812589 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12707): Process ended prematurely: osmo-stp_10.42.42.5(pid=12707) [trial-2360↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12707)] [trial-2360↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 13:49:10.821137 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 13:49:10.847491 run osmo-hlr_10.42.42.2(pid=12704): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12704)] 13:49:10.895346 run osmo-hlr_10.42.42.2(pid=12704): stdout: | (launched: 2022-12-09_13:49:07.945624) 13:49:10.945116 run osmo-hlr_10.42.42.2(pid=12704): stderr: | 20221209134908122 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134908122 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134908122 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134908122 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134908122 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134908122 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134908134 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134908142 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134908143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134908143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:11.014203 run osmo-msc_10.42.42.6(pid=12710): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12710)] 13:49:11.061607 run osmo-msc_10.42.42.6(pid=12710): stdout: | (launched: 2022-12-09_13:49:09.963099) 13:49:11.110576 run osmo-msc_10.42.42.6(pid=12710): stderr: | 20221209134910234 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134910234 DLGLOBAL DEBUG validating counter group 0x7f52155b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134910234 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134910234 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134910235 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134910235 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134910237 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134910237 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134910237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134910237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:49:11.160247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12703): Terminating (SIGTERM) 13:49:11.199699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12706): Terminating (SIGTERM) 13:49:11.239156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12709): Terminating (SIGTERM) 13:49:11.279288 --- ParallelTerminationStrategy: PID 12703 died... 13:49:11.298379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12703): Terminated: ok {rc=0} 13:49:11.342244 --- ParallelTerminationStrategy: PID 12706 died... 13:49:11.360736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12706): Terminated: ok {rc=0} 13:49:11.404642 --- ParallelTerminationStrategy: PID 12709 died... 13:49:11.423402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12709): Terminated: ok {rc=0} 13:49:11.505971 bus /sierra_3: Setting Powered False 13:49:12.600758 bus /sierra_3: Setting Powered False 13:49:13.715729 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 13:49:14.803089 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:49:14.814683 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:49:14.856157 tst emergency_preemptive_call.py: using LAC 21889 13:49:14.973800 tst emergency_preemptive_call.py: using RAC 214 13:49:15.090034 tst emergency_preemptive_call.py: using CellId 21889 13:49:15.206267 tst emergency_preemptive_call.py: using BVCI 21890 13:49:15.313550 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:49:15.324505 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:49:15.335159 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:49:15.345920 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:49:15.356693 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:49:15.367486 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:49:15.483562 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:49:15.603669 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:49:15.717784 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:49:15.843379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:16.365525 run create_hlr_db(pid=12712): Launched 13:49:16.524736 bus /sierra_2: Setting Powered False 13:49:17.587904 run create_hlr_db(pid=12712): Terminated: ok {rc=0} 13:49:18.014357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12714): Launched 13:49:18.310815 run osmo-hlr_10.42.42.2(pid=12715): Launched 13:49:18.423136 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:18.931103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12717): Launched 13:49:19.226286 run osmo-stp_10.42.42.5(pid=12718): Launched 13:49:19.352470 tst emergency_preemptive_call.py: using MSISDN 7237 13:49:19.504475 run osmo-msc_10.42.42.6: Starting osmo-msc 13:49:20.035422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12720): Launched 13:49:20.330720 run osmo-msc_10.42.42.6(pid=12721): Launched 13:49:20.496674 run osmo-stp_10.42.42.5(pid=12718): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12718)] 13:49:20.621715 run osmo-stp_10.42.42.5(pid=12718): stdout: | (launched: 2022-12-09_13:49:19.171437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:20.747552 run osmo-stp_10.42.42.5(pid=12718): stderr: | 20221209134919340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134919340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134919340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134919341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134919343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134919344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134919344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:20.871528 run osmo-stp_10.42.42.5(pid=12718): stdout: | (launched: 2022-12-09_13:49:19.171437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:20.989200 run osmo-stp_10.42.42.5(pid=12718): stderr: | 20221209134919340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134919340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134919340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134919341 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134919343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134919344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134919344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:21.129700 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12718): Process ended prematurely: osmo-stp_10.42.42.5(pid=12718) [trial-2360↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12718)] [trial-2360↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 13:49:21.138174 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 13:49:21.164523 run osmo-hlr_10.42.42.2(pid=12715): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12715)] 13:49:21.212299 run osmo-hlr_10.42.42.2(pid=12715): stdout: | (launched: 2022-12-09_13:49:18.255610) 13:49:21.261804 run osmo-hlr_10.42.42.2(pid=12715): stderr: | 20221209134918433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134918433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134918433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134918433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134918433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134918433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134918445 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134918453 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134918454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134918454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:21.331080 run osmo-msc_10.42.42.6(pid=12721): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12721)] 13:49:21.378889 run osmo-msc_10.42.42.6(pid=12721): stdout: | (launched: 2022-12-09_13:49:20.275814) 13:49:21.428017 run osmo-msc_10.42.42.6(pid=12721): stderr: | 20221209134920548 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209134920548 DLGLOBAL DEBUG validating counter group 0x7f9e9e41dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209134920548 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209134920548 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209134920549 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209134920549 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209134920551 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209134920551 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209134920551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209134920551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:49:21.477514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12714): Terminating (SIGTERM) 13:49:21.517125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12717): Terminating (SIGTERM) 13:49:21.556894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12720): Terminating (SIGTERM) 13:49:21.597432 --- ParallelTerminationStrategy: PID 12714 died... 13:49:21.616409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12714): Terminated: ok {rc=0} 13:49:21.660878 --- ParallelTerminationStrategy: PID 12717 died... 13:49:21.679795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12717): Terminated: ok {rc=0} 13:49:21.724173 --- ParallelTerminationStrategy: PID 12720 died... 13:49:21.742925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12720): Terminated: ok {rc=0} 13:49:21.828213 bus /sierra_9: Setting Powered False 13:49:22.926868 bus /sierra_9: Setting Powered False 13:49:24.042522 bus /sierra_8: Setting Powered False 13:49:25.141373 bus /sierra_8: Setting Powered False 13:49:26.259943 bus /sierra_3: Setting Powered False 13:49:27.358928 bus /sierra_3: Setting Powered False 13:49:28.473759 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:nanobts+band-1900 --------------------------------------------------------------------- 13:49:29.749851 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:49:29.756098 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 13:49:29.779926 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 13:49:29.818210 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 13:49:29.904513 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 13:49:29.927772 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 13:49:29.965860 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 13:49:30.557842 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 13:49:30.606779 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:30.617570 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:49:30.655509 tst cs_paging_gprs_active.py: using LAC 21890 13:49:30.787103 tst cs_paging_gprs_active.py: using RAC 215 13:49:30.937674 tst cs_paging_gprs_active.py: using CellId 21890 13:49:31.065825 tst cs_paging_gprs_active.py: using BVCI 21891 13:49:31.188532 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:31.201351 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:31.213388 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:31.226577 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:31.240618 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:31.253927 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:31.266214 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:31.279196 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:31.292356 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:49:31.420088 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:49:31.564428 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:49:31.778961 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:32.105776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12728): Launched 13:49:32.381510 run iperf3-srv_10.42.42.10(pid=12729): Launched 13:49:32.494711 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:49:32.696343 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:32.999595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12730): Launched 13:49:33.262766 run iperf3-srv_10.42.42.10(pid=12731): Launched 13:49:33.375351 tst cs_paging_gprs_active.py:38: start network... 13:49:33.575430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:34.043204 run create_hlr_db(pid=12732): Launched 13:49:34.167429 bus /sierra_2: Setting Powered False 13:49:35.227303 run create_hlr_db(pid=12732): Terminated: ok {rc=0} 13:49:35.666450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12734): Launched 13:49:35.988710 run osmo-hlr_10.42.42.2(pid=12735): Launched 13:49:36.112329 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:36.667020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12737): Launched 13:49:36.990020 run osmo-stp_10.42.42.5(pid=12738): Launched 13:49:37.113093 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:49:37.670025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12740): Launched 13:49:37.793172 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:49:38.066931 run patchelf(pid=12741): Launched 13:49:38.246350 run osmo-stp_10.42.42.5(pid=12738): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12738)] 13:49:38.383092 run osmo-stp_10.42.42.5(pid=12738): stdout: | (launched: 2022-12-09_13:49:36.931103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:38.521458 run osmo-stp_10.42.42.5(pid=12738): stderr: | 20221209134937121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134937121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134937121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134937122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134937122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134937122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134937122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:38.659783 run osmo-stp_10.42.42.5(pid=12738): stdout: | (launched: 2022-12-09_13:49:36.931103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:38.792106 run osmo-stp_10.42.42.5(pid=12738): stderr: | 20221209134937121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134937121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134937121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134937122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134937122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134937122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134937122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:38.949835 run patchelf(pid=12741): Terminating (SIGINT) 13:49:39.129922 run patchelf(pid=12741): Terminated: ok {rc=0} 13:49:39.259646 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12738): Process ended prematurely: osmo-stp_10.42.42.5(pid=12738) [trial-2360↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12738)] [trial-2360↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 13:49:39.269931 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:49:39.299090 run osmo-hlr_10.42.42.2(pid=12735): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12735)] 13:49:39.349558 run osmo-hlr_10.42.42.2(pid=12735): stdout: | (launched: 2022-12-09_13:49:35.929791) 13:49:39.401448 run osmo-hlr_10.42.42.2(pid=12735): stderr: | 20221209134936128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134936128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134936128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134936128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134936128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134936128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134936143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134936153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134936153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134936154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:39.453859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12728): Terminating (SIGTERM) 13:49:39.495996 run iperf3-srv_10.42.42.10(pid=12729): Terminating (SIGTERM) 13:49:39.538025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12730): Terminating (SIGTERM) 13:49:39.580269 run iperf3-srv_10.42.42.10(pid=12731): Terminating (SIGTERM) 13:49:39.622454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12734): Terminating (SIGTERM) 13:49:39.664496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12737): Terminating (SIGTERM) 13:49:39.706738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12740): Terminating (SIGTERM) 13:49:39.749125 --- ParallelTerminationStrategy: PID 12728 died... 13:49:39.769175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12728): Terminated: ok {rc=0} 13:49:39.816082 --- ParallelTerminationStrategy: PID 12729 died... 13:49:39.835434 run iperf3-srv_10.42.42.10(pid=12729): Terminated {rc=256} 13:49:39.882120 --- ParallelTerminationStrategy: PID 12730 died... 13:49:39.901956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12730): Terminated: ok {rc=0} 13:49:39.949904 --- ParallelTerminationStrategy: PID 12731 died... 13:49:39.969514 run iperf3-srv_10.42.42.10(pid=12731): Terminated {rc=256} 13:49:40.015948 --- ParallelTerminationStrategy: PID 12734 died... 13:49:40.035497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12734): Terminated: ok {rc=0} 13:49:40.081911 --- ParallelTerminationStrategy: PID 12737 died... 13:49:40.101506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12737): Terminated: ok {rc=0} 13:49:40.147864 --- ParallelTerminationStrategy: PID 12740 died... 13:49:40.167668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12740): Terminated: ok {rc=0} 13:49:40.255868 bus /gobi_0: Setting Powered False 13:49:41.354402 bus /gobi_0: Setting Powered False 13:49:42.470434 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 13:49:43.619350 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:43.631342 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:49:43.671642 tst iperf3.py: using LAC 21891 13:49:43.798851 tst iperf3.py: using RAC 216 13:49:43.929645 tst iperf3.py: using CellId 21891 13:49:44.054900 tst iperf3.py: using BVCI 21892 13:49:44.171710 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:44.182961 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:44.194202 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:44.205507 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:44.216586 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:44.227825 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:44.239191 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:44.250450 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:44.261876 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:49:44.382451 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:49:44.598133 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:44.920568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12742): Launched 13:49:45.200725 run iperf3-srv_10.42.42.10(pid=12743): Launched 13:49:45.321861 tst iperf3.py:8: start network... 13:49:45.538074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:46.056931 run create_hlr_db(pid=12744): Launched 13:49:46.213237 bus /gobi_6: Setting Powered False 13:49:47.285083 run create_hlr_db(pid=12744): Terminated: ok {rc=0} 13:49:47.716682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12746): Launched 13:49:48.019661 run osmo-hlr_10.42.42.2(pid=12747): Launched 13:49:48.135452 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:48.655336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12749): Launched 13:49:48.955054 run osmo-stp_10.42.42.5(pid=12750): Launched 13:49:49.069367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:49:49.590786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12752): Launched 13:49:49.706001 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:49:49.962382 run patchelf(pid=12753): Launched 13:49:50.141258 run osmo-stp_10.42.42.5(pid=12750): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12750)] 13:49:50.278113 run osmo-stp_10.42.42.5(pid=12750): stdout: | (launched: 2022-12-09_13:49:48.899722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:50.415972 run osmo-stp_10.42.42.5(pid=12750): stderr: | 20221209134949069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134949069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134949069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134949070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134949070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134949070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134949070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:50.554115 run osmo-stp_10.42.42.5(pid=12750): stdout: | (launched: 2022-12-09_13:49:48.899722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:50.686571 run osmo-stp_10.42.42.5(pid=12750): stderr: | 20221209134949069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209134949069 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209134949069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209134949070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209134949070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209134949070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209134949070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:50.843246 run patchelf(pid=12753): Terminating (SIGINT) 13:49:51.023015 run patchelf(pid=12753): Terminated: ok {rc=0} 13:49:51.152617 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12750): Process ended prematurely: osmo-stp_10.42.42.5(pid=12750) [trial-2360↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12750)] [trial-2360↪gprs:nanobts+band-1900↪iperf3.py:8] 13:49:51.162855 tst iperf3.py:8: Test FAILED (7.6 sec) 13:49:51.191541 run osmo-hlr_10.42.42.2(pid=12747): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12747)] 13:49:51.242006 run osmo-hlr_10.42.42.2(pid=12747): stdout: | (launched: 2022-12-09_13:49:47.964016) 13:49:51.294187 run osmo-hlr_10.42.42.2(pid=12747): stderr: | 20221209134948139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209134948139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209134948139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209134948139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209134948139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209134948139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209134948154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209134948164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209134948164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209134948164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:51.346879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12742): Terminating (SIGTERM) 13:49:51.389382 run iperf3-srv_10.42.42.10(pid=12743): Terminating (SIGTERM) 13:49:51.431512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12746): Terminating (SIGTERM) 13:49:51.473809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12749): Terminating (SIGTERM) 13:49:51.516038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12752): Terminating (SIGTERM) 13:49:51.558663 --- ParallelTerminationStrategy: PID 12742 died... 13:49:51.578867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12742): Terminated: ok {rc=0} 13:49:51.625708 --- ParallelTerminationStrategy: PID 12743 died... 13:49:51.645546 run iperf3-srv_10.42.42.10(pid=12743): Terminated {rc=256} 13:49:51.692261 --- ParallelTerminationStrategy: PID 12746 died... 13:49:51.712045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12746): Terminated: ok {rc=0} 13:49:51.759200 --- ParallelTerminationStrategy: PID 12749 died... 13:49:51.779261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12749): Terminated: ok {rc=0} 13:49:51.826084 --- ParallelTerminationStrategy: PID 12752 died... 13:49:51.845980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12752): Terminated: ok {rc=0} 13:49:51.934167 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 13:49:53.081428 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:53.092888 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:49:53.132826 tst iperf3m4.py: using LAC 21892 13:49:53.252861 tst iperf3m4.py: using RAC 217 13:49:53.373080 tst iperf3m4.py: using CellId 21892 13:49:53.492931 tst iperf3m4.py: using BVCI 21893 13:49:53.602289 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:53.612882 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:53.623424 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:53.633997 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:53.644300 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:53.654684 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:53.665615 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:53.675959 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:49:53.687247 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:49:53.806018 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:49:53.925899 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:49:54.046031 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:49:54.164006 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:49:54.381132 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:54.705282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12754): Launched 13:49:54.985813 run iperf3-srv_10.42.42.10(pid=12755): Launched 13:49:55.106215 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:49:55.321991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:55.644888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12756): Launched 13:49:55.923795 run iperf3-srv_10.42.42.10(pid=12757): Launched 13:49:56.044412 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:49:56.259982 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:56.583035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12758): Launched 13:49:56.862896 run iperf3-srv_10.42.42.10(pid=12759): Launched 13:49:56.983959 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:49:57.200096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:57.523404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12760): Launched 13:49:57.802587 run iperf3-srv_10.42.42.10(pid=12761): Launched 13:49:57.923326 tst iperf3m4.py:8: start network... 13:49:58.139075 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:58.638750 run create_hlr_db(pid=12762): Launched 13:49:58.761563 bus /gobi_6: Setting Powered False 13:49:59.825186 run create_hlr_db(pid=12762): Terminated: ok {rc=0} 13:50:00.256310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12764): Launched 13:50:00.559072 run osmo-hlr_10.42.42.2(pid=12765): Launched 13:50:00.675114 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:01.285480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12767): Launched 13:50:01.649789 run osmo-stp_10.42.42.5(pid=12771): Launched 13:50:01.895493 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:50:02.527521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12773): Launched 13:50:02.651345 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:50:02.924161 run patchelf(pid=12774): Launched 13:50:03.105217 run osmo-stp_10.42.42.5(pid=12771): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12771)] 13:50:03.241713 run osmo-stp_10.42.42.5(pid=12771): stdout: | (launched: 2022-12-09_13:50:01.584833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:03.379452 run osmo-stp_10.42.42.5(pid=12771): stderr: | 20221209135001879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135001879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135001879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135001880 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135001880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135001880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135001881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:03.517374 run osmo-stp_10.42.42.5(pid=12771): stdout: | (launched: 2022-12-09_13:50:01.584833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:03.649580 run osmo-stp_10.42.42.5(pid=12771): stderr: | 20221209135001879 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135001879 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135001879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135001880 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135001880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135001880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135001881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:03.806225 run patchelf(pid=12774): Terminating (SIGINT) 13:50:03.986636 run patchelf(pid=12774): Terminated: ok {rc=0} 13:50:04.116127 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12771): Process ended prematurely: osmo-stp_10.42.42.5(pid=12771) [trial-2360↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12771)] [trial-2360↪gprs:nanobts+band-1900↪iperf3m4.py:8] 13:50:04.126409 tst iperf3m4.py:8: Test FAILED (11.1 sec) 13:50:04.155559 run osmo-hlr_10.42.42.2(pid=12765): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12765)] 13:50:04.205753 run osmo-hlr_10.42.42.2(pid=12765): stdout: | (launched: 2022-12-09_13:50:00.503232) 13:50:04.257529 run osmo-hlr_10.42.42.2(pid=12765): stderr: | 20221209135000678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135000678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135000678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135000678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135000678 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135000678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135000690 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135000699 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135000699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135000700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:04.309927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12754): Terminating (SIGTERM) 13:50:04.352294 run iperf3-srv_10.42.42.10(pid=12755): Terminating (SIGTERM) 13:50:04.394561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12756): Terminating (SIGTERM) 13:50:04.436261 run iperf3-srv_10.42.42.10(pid=12757): Terminating (SIGTERM) 13:50:04.477989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12758): Terminating (SIGTERM) 13:50:04.519720 run iperf3-srv_10.42.42.10(pid=12759): Terminating (SIGTERM) 13:50:04.561331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12760): Terminating (SIGTERM) 13:50:04.602956 run iperf3-srv_10.42.42.10(pid=12761): Terminating (SIGTERM) 13:50:04.644481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12764): Terminating (SIGTERM) 13:50:04.686272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12767): Terminating (SIGTERM) 13:50:04.727892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12773): Terminating (SIGTERM) 13:50:04.769772 --- ParallelTerminationStrategy: PID 12754 died... 13:50:04.789447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12754): Terminated: ok {rc=0} 13:50:04.835857 --- ParallelTerminationStrategy: PID 12755 died... 13:50:04.855509 run iperf3-srv_10.42.42.10(pid=12755): Terminated {rc=256} 13:50:04.901827 --- ParallelTerminationStrategy: PID 12756 died... 13:50:04.921379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12756): Terminated: ok {rc=0} 13:50:04.967580 --- ParallelTerminationStrategy: PID 12757 died... 13:50:04.987007 run iperf3-srv_10.42.42.10(pid=12757): Terminated {rc=256} 13:50:05.032927 --- ParallelTerminationStrategy: PID 12758 died... 13:50:05.052359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12758): Terminated: ok {rc=0} 13:50:05.098405 --- ParallelTerminationStrategy: PID 12759 died... 13:50:05.117793 run iperf3-srv_10.42.42.10(pid=12759): Terminated {rc=256} 13:50:05.163840 --- ParallelTerminationStrategy: PID 12760 died... 13:50:05.183301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12760): Terminated: ok {rc=0} 13:50:05.229366 --- ParallelTerminationStrategy: PID 12761 died... 13:50:05.248845 run iperf3-srv_10.42.42.10(pid=12761): Terminated {rc=256} 13:50:05.294910 --- ParallelTerminationStrategy: PID 12764 died... 13:50:05.314414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12764): Terminated: ok {rc=0} 13:50:05.360643 --- ParallelTerminationStrategy: PID 12767 died... 13:50:05.380538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12767): Terminated: ok {rc=0} 13:50:05.426713 --- ParallelTerminationStrategy: PID 12773 died... 13:50:05.446271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12773): Terminated: ok {rc=0} 13:50:05.533283 bus /gobi_4: Setting Powered False 13:50:06.633021 bus /gobi_4: Setting Powered False 13:50:07.748180 bus /gobi_1: Setting Powered False 13:50:08.843443 bus /gobi_1: Setting Powered False 13:50:09.961394 bus /gobi_0: Setting Powered False 13:50:11.058836 bus /gobi_0: Setting Powered False 13:50:12.175406 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 13:50:13.277275 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:50:13.288894 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:50:13.329636 tst ping.py: using LAC 21893 13:50:13.446616 tst ping.py: using RAC 218 13:50:13.564797 tst ping.py: using CellId 21893 13:50:13.688432 tst ping.py: using BVCI 21894 13:50:13.802842 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:50:13.814180 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:50:13.825543 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:50:13.836627 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:50:13.847995 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:50:13.859595 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:50:13.870982 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:50:13.882150 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:50:13.999273 tst ping.py:19: start network... 13:50:14.210976 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:14.698772 run create_hlr_db(pid=12775): Launched 13:50:14.818078 bus /gobi_6: Setting Powered False 13:50:15.904442 run create_hlr_db(pid=12775): Terminated: ok {rc=0} 13:50:16.377409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12777): Launched 13:50:16.708327 run osmo-hlr_10.42.42.2(pid=12778): Launched 13:50:16.860408 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:17.519384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12780): Launched 13:50:17.836556 run osmo-stp_10.42.42.5(pid=12781): Launched 13:50:17.957751 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:50:18.503084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12783): Launched 13:50:18.623702 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:50:18.890176 run patchelf(pid=12784): Launched 13:50:19.066250 run osmo-stp_10.42.42.5(pid=12781): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12781)] 13:50:19.200569 run osmo-stp_10.42.42.5(pid=12781): stdout: | (launched: 2022-12-09_13:50:17.778315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:19.336396 run osmo-stp_10.42.42.5(pid=12781): stderr: | 20221209135017972 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135017973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135017973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135017973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135017974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135017974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135017974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:19.472064 run osmo-stp_10.42.42.5(pid=12781): stdout: | (launched: 2022-12-09_13:50:17.778315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:19.602311 run osmo-stp_10.42.42.5(pid=12781): stderr: | 20221209135017972 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135017973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135017973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135017973 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135017974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135017974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135017974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:19.755981 run patchelf(pid=12784): Terminating (SIGINT) 13:50:19.933083 run patchelf(pid=12784): Terminated: ok {rc=0} 13:50:20.060507 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12781): Process ended prematurely: osmo-stp_10.42.42.5(pid=12781) [trial-2360↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12781)] [trial-2360↪gprs:nanobts+band-1900↪ping.py:22] 13:50:20.070234 tst ping.py:22: Test FAILED (6.8 sec) 13:50:20.098983 run osmo-hlr_10.42.42.2(pid=12778): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12778)] 13:50:20.149277 run osmo-hlr_10.42.42.2(pid=12778): stdout: | (launched: 2022-12-09_13:50:16.648925) 13:50:20.201157 run osmo-hlr_10.42.42.2(pid=12778): stderr: | 20221209135017030 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135017031 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135017031 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135017031 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135017031 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135017031 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135017054 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135017081 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135017081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135017081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:20.253463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12777): Terminating (SIGTERM) 13:50:20.295542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12780): Terminating (SIGTERM) 13:50:20.337593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12783): Terminating (SIGTERM) 13:50:20.379999 --- ParallelTerminationStrategy: PID 12777 died... 13:50:20.400099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12777): Terminated: ok {rc=0} 13:50:20.446986 --- ParallelTerminationStrategy: PID 12780 died... 13:50:20.466821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12780): Terminated: ok {rc=0} 13:50:20.513796 --- ParallelTerminationStrategy: PID 12783 died... 13:50:20.533628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12783): Terminated: ok {rc=0} 13:50:20.621884 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 13:50:21.708146 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:50:21.720095 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:50:21.767681 tst ping_idle_ping.py: using LAC 21894 13:50:21.892809 tst ping_idle_ping.py: using RAC 219 13:50:22.018971 tst ping_idle_ping.py: using CellId 21894 13:50:22.141351 tst ping_idle_ping.py: using BVCI 21895 13:50:22.256933 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:50:22.268476 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:50:22.279820 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:50:22.291712 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:50:22.303533 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:50:22.315368 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:50:22.327484 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:50:22.339485 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:50:22.455899 tst ping_idle_ping.py:24: start network... 13:50:22.656387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:23.118405 run create_hlr_db(pid=12785): Launched 13:50:23.240449 bus /gobi_6: Setting Powered False 13:50:24.300211 run create_hlr_db(pid=12785): Terminated: ok {rc=0} 13:50:24.735305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12787): Launched 13:50:25.052418 run osmo-hlr_10.42.42.2(pid=12788): Launched 13:50:25.174013 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:25.723965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12790): Launched 13:50:26.042452 run osmo-stp_10.42.42.5(pid=12791): Launched 13:50:26.163403 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:50:26.711322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12793): Launched 13:50:26.833726 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:50:27.102679 run patchelf(pid=12794): Launched 13:50:27.279490 run osmo-stp_10.42.42.5(pid=12791): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12791)] 13:50:27.414481 run osmo-stp_10.42.42.5(pid=12791): stdout: | (launched: 2022-12-09_13:50:25.984087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:27.551120 run osmo-stp_10.42.42.5(pid=12791): stderr: | 20221209135026176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135026176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135026176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135026176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135026177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135026177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135026177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:27.688165 run osmo-stp_10.42.42.5(pid=12791): stdout: | (launched: 2022-12-09_13:50:25.984087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:27.819027 run osmo-stp_10.42.42.5(pid=12791): stderr: | 20221209135026176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135026176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135026176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135026176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135026177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135026177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135026177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:27.974510 run patchelf(pid=12794): Terminating (SIGINT) 13:50:28.152443 run patchelf(pid=12794): Terminated: ok {rc=0} 13:50:28.280654 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12791): Process ended prematurely: osmo-stp_10.42.42.5(pid=12791) [trial-2360↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12791)] [trial-2360↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 13:50:28.290346 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:50:28.318737 run osmo-hlr_10.42.42.2(pid=12788): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12788)] 13:50:28.369353 run osmo-hlr_10.42.42.2(pid=12788): stdout: | (launched: 2022-12-09_13:50:24.994454) 13:50:28.421728 run osmo-hlr_10.42.42.2(pid=12788): stderr: | 20221209135025194 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135025194 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135025194 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135025194 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135025194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135025194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135025207 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135025215 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135025215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135025216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:28.474488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12787): Terminating (SIGTERM) 13:50:28.516628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12790): Terminating (SIGTERM) 13:50:28.558942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12793): Terminating (SIGTERM) 13:50:28.601326 --- ParallelTerminationStrategy: PID 12787 died... 13:50:28.621450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12787): Terminated: ok {rc=0} 13:50:28.668298 --- ParallelTerminationStrategy: PID 12790 died... 13:50:28.688135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12790): Terminated: ok {rc=0} 13:50:28.735065 --- ParallelTerminationStrategy: PID 12793 died... 13:50:28.754954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12793): Terminated: ok {rc=0} 13:50:28.842731 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 13:50:30.146371 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:50:30.152725 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:50:30.177847 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:50:30.217450 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:50:30.302428 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:50:30.325866 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:50:30.364501 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:50:31.001448 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:50:31.069372 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:31.083685 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:50:31.132114 tst cs_paging_gprs_active.py: using LAC 21895 13:50:31.254217 tst cs_paging_gprs_active.py: using RAC 220 13:50:31.385398 tst cs_paging_gprs_active.py: using CellId 21895 13:50:31.541358 tst cs_paging_gprs_active.py: using BVCI 21896 13:50:31.701311 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:31.717876 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:31.735189 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:31.751905 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:31.767569 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:31.783000 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:31.799616 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:31.816411 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:31.833773 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:31.980272 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:32.100928 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:50:32.340024 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:32.666296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12798): Launched 13:50:32.947224 run iperf3-srv_10.42.42.10(pid=12799): Launched 13:50:33.068789 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:50:33.286904 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:33.610403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12800): Launched 13:50:33.890735 run iperf3-srv_10.42.42.10(pid=12801): Launched 13:50:34.011555 tst cs_paging_gprs_active.py:38: start network... 13:50:34.228619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:34.728404 run create_hlr_db(pid=12802): Launched 13:50:34.851037 bus /gobi_6: Setting Powered False 13:50:35.914737 run create_hlr_db(pid=12802): Terminated: ok {rc=0} 13:50:36.362549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12804): Launched 13:50:36.684648 run osmo-hlr_10.42.42.2(pid=12805): Launched 13:50:36.807556 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:37.360466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12807): Launched 13:50:37.681720 run osmo-stp_10.42.42.5(pid=12808): Launched 13:50:37.804718 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:50:38.362588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12810): Launched 13:50:38.485503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:50:38.757900 run patchelf(pid=12811): Launched 13:50:38.937170 run osmo-stp_10.42.42.5(pid=12808): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12808)] 13:50:39.074002 run osmo-stp_10.42.42.5(pid=12808): stdout: | (launched: 2022-12-09_13:50:37.622735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:39.211897 run osmo-stp_10.42.42.5(pid=12808): stderr: | 20221209135037814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135037814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135037814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135037815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135037815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135037815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135037815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:39.350579 run osmo-stp_10.42.42.5(pid=12808): stdout: | (launched: 2022-12-09_13:50:37.622735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:39.482786 run osmo-stp_10.42.42.5(pid=12808): stderr: | 20221209135037814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135037814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135037814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135037815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135037815 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135037815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135037815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:39.639517 run patchelf(pid=12811): Terminating (SIGINT) 13:50:39.819330 run patchelf(pid=12811): Terminated: ok {rc=0} 13:50:39.949670 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12808): Process ended prematurely: osmo-stp_10.42.42.5(pid=12808) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12808)] [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:50:39.960168 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:50:39.989629 run osmo-hlr_10.42.42.2(pid=12805): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12805)] 13:50:40.039959 run osmo-hlr_10.42.42.2(pid=12805): stdout: | (launched: 2022-12-09_13:50:36.625455) 13:50:40.092062 run osmo-hlr_10.42.42.2(pid=12805): stderr: | 20221209135036823 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135036823 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135036823 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135036823 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135036823 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135036823 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135036836 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135036844 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135036844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135036844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:40.144679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12798): Terminating (SIGTERM) 13:50:40.186756 run iperf3-srv_10.42.42.10(pid=12799): Terminating (SIGTERM) 13:50:40.228668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12800): Terminating (SIGTERM) 13:50:40.270712 run iperf3-srv_10.42.42.10(pid=12801): Terminating (SIGTERM) 13:50:40.312553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12804): Terminating (SIGTERM) 13:50:40.354539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12807): Terminating (SIGTERM) 13:50:40.396310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12810): Terminating (SIGTERM) 13:50:40.438608 --- ParallelTerminationStrategy: PID 12798 died... 13:50:40.458733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12798): Terminated: ok {rc=0} 13:50:40.505422 --- ParallelTerminationStrategy: PID 12799 died... 13:50:40.524922 run iperf3-srv_10.42.42.10(pid=12799): Terminated {rc=256} 13:50:40.571123 --- ParallelTerminationStrategy: PID 12800 died... 13:50:40.590758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12800): Terminated: ok {rc=0} 13:50:40.637334 --- ParallelTerminationStrategy: PID 12801 died... 13:50:40.656848 run iperf3-srv_10.42.42.10(pid=12801): Terminated {rc=256} 13:50:40.703203 --- ParallelTerminationStrategy: PID 12804 died... 13:50:40.722762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12804): Terminated: ok {rc=0} 13:50:40.769323 --- ParallelTerminationStrategy: PID 12807 died... 13:50:40.788916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12807): Terminated: ok {rc=0} 13:50:40.835657 --- ParallelTerminationStrategy: PID 12810 died... 13:50:40.855368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12810): Terminated: ok {rc=0} 13:50:40.943486 bus /gobi_0: Setting Powered False 13:50:42.043275 bus /gobi_0: Setting Powered False 13:50:43.159568 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:50:44.308504 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:44.320617 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:50:44.365449 tst iperf3.py: using LAC 21896 13:50:44.493130 tst iperf3.py: using RAC 221 13:50:44.618686 tst iperf3.py: using CellId 21896 13:50:44.748027 tst iperf3.py: using BVCI 21897 13:50:44.859308 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:44.870587 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:44.881582 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:44.892693 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:44.903738 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:44.914772 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:44.926069 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:44.936817 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:44.947913 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:45.064347 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:50:45.283640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:45.608665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12812): Launched 13:50:45.899601 run iperf3-srv_10.42.42.10(pid=12813): Launched 13:50:46.035895 tst iperf3.py:8: start network... 13:50:46.257484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:46.766839 run create_hlr_db(pid=12814): Launched 13:50:46.929448 bus /gobi_6: Setting Powered False 13:50:47.992525 run create_hlr_db(pid=12814): Terminated: ok {rc=0} 13:50:48.424656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12816): Launched 13:50:48.729575 run osmo-hlr_10.42.42.2(pid=12817): Launched 13:50:48.845297 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:49.371040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12819): Launched 13:50:49.672910 run osmo-stp_10.42.42.5(pid=12820): Launched 13:50:49.787629 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:50:50.307613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12822): Launched 13:50:50.422756 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:50:50.678575 run patchelf(pid=12823): Launched 13:50:50.846500 run osmo-stp_10.42.42.5(pid=12820): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12820)] 13:50:50.974862 run osmo-stp_10.42.42.5(pid=12820): stdout: | (launched: 2022-12-09_13:50:49.617225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:51.104691 run osmo-stp_10.42.42.5(pid=12820): stderr: | 20221209135049789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135049789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135049790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135049790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135049790 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135049790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135049790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:51.235102 run osmo-stp_10.42.42.5(pid=12820): stdout: | (launched: 2022-12-09_13:50:49.617225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:51.359249 run osmo-stp_10.42.42.5(pid=12820): stderr: | 20221209135049789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135049789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135049790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135049790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135049790 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135049790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135049790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:51.507125 run patchelf(pid=12823): Terminating (SIGINT) 13:50:51.676706 run patchelf(pid=12823): Terminated: ok {rc=0} 13:50:51.798800 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12820): Process ended prematurely: osmo-stp_10.42.42.5(pid=12820) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12820)] [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 13:50:51.808106 tst iperf3.py:8: Test FAILED (7.5 sec) 13:50:51.835437 run osmo-hlr_10.42.42.2(pid=12817): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12817)] 13:50:51.882876 run osmo-hlr_10.42.42.2(pid=12817): stdout: | (launched: 2022-12-09_13:50:48.672625) 13:50:51.932613 run osmo-hlr_10.42.42.2(pid=12817): stderr: | 20221209135048849 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135048849 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135048849 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135048850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135048850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135048850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135048862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135048871 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135048871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135048871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:51.982476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12812): Terminating (SIGTERM) 13:50:52.022810 run iperf3-srv_10.42.42.10(pid=12813): Terminating (SIGTERM) 13:50:52.063055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12816): Terminating (SIGTERM) 13:50:52.102908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12819): Terminating (SIGTERM) 13:50:52.142852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12822): Terminating (SIGTERM) 13:50:52.183705 --- ParallelTerminationStrategy: PID 12812 died... 13:50:52.203074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12812): Terminated: ok {rc=0} 13:50:52.247915 --- ParallelTerminationStrategy: PID 12813 died... 13:50:52.266847 run iperf3-srv_10.42.42.10(pid=12813): Terminated {rc=256} 13:50:52.310979 --- ParallelTerminationStrategy: PID 12816 died... 13:50:52.329879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12816): Terminated: ok {rc=0} 13:50:52.374010 --- ParallelTerminationStrategy: PID 12819 died... 13:50:52.392880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12819): Terminated: ok {rc=0} 13:50:52.437212 --- ParallelTerminationStrategy: PID 12822 died... 13:50:52.455933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12822): Terminated: ok {rc=0} 13:50:52.541614 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:50:53.689045 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:53.700761 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:50:53.766595 tst iperf3m4.py: using LAC 21897 13:50:53.885624 tst iperf3m4.py: using RAC 222 13:50:54.007209 tst iperf3m4.py: using CellId 21897 13:50:54.130084 tst iperf3m4.py: using BVCI 21898 13:50:54.241925 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:54.253173 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:54.264075 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:54.275185 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:54.286255 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:54.297229 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:54.308515 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:54.319609 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:54.330860 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:54.449465 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:54.569624 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:54.689649 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:54.805932 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:50:55.008337 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:55.312715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12824): Launched 13:50:55.576881 run iperf3-srv_10.42.42.10(pid=12825): Launched 13:50:55.690727 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:50:55.893169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:56.196889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12826): Launched 13:50:56.459990 run iperf3-srv_10.42.42.10(pid=12827): Launched 13:50:56.573987 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:50:56.775796 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:57.078935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12828): Launched 13:50:57.341153 run iperf3-srv_10.42.42.10(pid=12829): Launched 13:50:57.454392 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:50:57.655470 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:57.959374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12830): Launched 13:50:58.222155 run iperf3-srv_10.42.42.10(pid=12831): Launched 13:50:58.335377 tst iperf3m4.py:8: start network... 13:50:58.536436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:59.007064 run create_hlr_db(pid=12832): Launched 13:50:59.130847 bus /gobi_6: Setting Powered False 13:51:00.191532 run create_hlr_db(pid=12832): Terminated: ok {rc=0} 13:51:00.633979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12834): Launched 13:51:00.961592 run osmo-hlr_10.42.42.2(pid=12835): Launched 13:51:01.209786 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:01.861693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12837): Launched 13:51:02.202262 run osmo-stp_10.42.42.5(pid=12838): Launched 13:51:02.405972 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:02.933103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12840): Launched 13:51:03.047640 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:03.302230 run patchelf(pid=12841): Launched 13:51:03.469454 run osmo-stp_10.42.42.5(pid=12838): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12838)] 13:51:03.596492 run osmo-stp_10.42.42.5(pid=12838): stdout: | (launched: 2022-12-09_13:51:02.139855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:03.724917 run osmo-stp_10.42.42.5(pid=12838): stderr: | 20221209135102327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135102328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135102328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135102328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135102329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135102329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135102329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:03.853760 run osmo-stp_10.42.42.5(pid=12838): stdout: | (launched: 2022-12-09_13:51:02.139855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:03.977190 run osmo-stp_10.42.42.5(pid=12838): stderr: | 20221209135102327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135102328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135102328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135102328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135102329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135102329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135102329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:04.123204 run patchelf(pid=12841): Terminating (SIGINT) 13:51:04.291794 run patchelf(pid=12841): Terminated: ok {rc=0} 13:51:04.412840 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12838): Process ended prematurely: osmo-stp_10.42.42.5(pid=12838) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12838)] [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 13:51:04.422286 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:51:04.449456 run osmo-hlr_10.42.42.2(pid=12835): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12835)] 13:51:04.496144 run osmo-hlr_10.42.42.2(pid=12835): stdout: | (launched: 2022-12-09_13:51:00.900764) 13:51:04.544733 run osmo-hlr_10.42.42.2(pid=12835): stderr: | 20221209135101202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135101202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135101202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135101202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135101202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135101202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135101258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135101275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135101275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135101275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:04.594039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12824): Terminating (SIGTERM) 13:51:04.633298 run iperf3-srv_10.42.42.10(pid=12825): Terminating (SIGTERM) 13:51:04.672460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12826): Terminating (SIGTERM) 13:51:04.711545 run iperf3-srv_10.42.42.10(pid=12827): Terminating (SIGTERM) 13:51:04.750723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12828): Terminating (SIGTERM) 13:51:04.789935 run iperf3-srv_10.42.42.10(pid=12829): Terminating (SIGTERM) 13:51:04.829516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12830): Terminating (SIGTERM) 13:51:04.868864 run iperf3-srv_10.42.42.10(pid=12831): Terminating (SIGTERM) 13:51:04.907869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12834): Terminating (SIGTERM) 13:51:04.947048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12837): Terminating (SIGTERM) 13:51:04.986237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12840): Terminating (SIGTERM) 13:51:05.025563 --- ParallelTerminationStrategy: PID 12824 died... 13:51:05.044627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12824): Terminated: ok {rc=0} 13:51:05.088092 --- ParallelTerminationStrategy: PID 12825 died... 13:51:05.106632 run iperf3-srv_10.42.42.10(pid=12825): Terminated {rc=256} 13:51:05.149831 --- ParallelTerminationStrategy: PID 12826 died... 13:51:05.168300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12826): Terminated: ok {rc=0} 13:51:05.211494 --- ParallelTerminationStrategy: PID 12827 died... 13:51:05.229911 run iperf3-srv_10.42.42.10(pid=12827): Terminated {rc=256} 13:51:05.273145 --- ParallelTerminationStrategy: PID 12828 died... 13:51:05.291565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12828): Terminated: ok {rc=0} 13:51:05.334875 --- ParallelTerminationStrategy: PID 12829 died... 13:51:05.353307 run iperf3-srv_10.42.42.10(pid=12829): Terminated {rc=256} 13:51:05.396501 --- ParallelTerminationStrategy: PID 12830 died... 13:51:05.415098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12830): Terminated: ok {rc=0} 13:51:05.458526 --- ParallelTerminationStrategy: PID 12831 died... 13:51:05.477058 run iperf3-srv_10.42.42.10(pid=12831): Terminated {rc=256} 13:51:05.520250 --- ParallelTerminationStrategy: PID 12834 died... 13:51:05.538770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12834): Terminated: ok {rc=0} 13:51:05.582697 --- ParallelTerminationStrategy: PID 12837 died... 13:51:05.601336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12837): Terminated: ok {rc=0} 13:51:05.644863 --- ParallelTerminationStrategy: PID 12840 died... 13:51:05.664029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12840): Terminated: ok {rc=0} 13:51:05.747715 bus /gobi_4: Setting Powered False 13:51:06.843392 bus /gobi_4: Setting Powered False 13:51:07.961249 bus /gobi_1: Setting Powered False 13:51:09.058573 bus /gobi_1: Setting Powered False 13:51:10.174391 bus /gobi_0: Setting Powered False 13:51:11.270068 bus /gobi_0: Setting Powered False 13:51:12.384444 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 13:51:13.488935 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:13.501476 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:51:13.544531 tst ping.py: using LAC 21898 13:51:13.669937 tst ping.py: using RAC 223 13:51:13.787010 tst ping.py: using CellId 21898 13:51:13.902420 tst ping.py: using BVCI 21899 13:51:14.011538 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:14.022757 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:14.033764 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:14.044573 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:14.055499 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:14.066209 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:14.077062 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:14.087709 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:51:14.204266 tst ping.py:19: start network... 13:51:14.416561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:14.905105 run create_hlr_db(pid=12843): Launched 13:51:15.026529 bus /gobi_6: Setting Powered False 13:51:16.087178 run create_hlr_db(pid=12843): Terminated: ok {rc=0} 13:51:16.556467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12845): Launched 13:51:16.901230 run osmo-hlr_10.42.42.2(pid=12846): Launched 13:51:17.144902 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:17.719207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12848): Launched 13:51:18.036104 run osmo-stp_10.42.42.5(pid=12849): Launched 13:51:18.156804 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:18.702691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12851): Launched 13:51:18.823663 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:19.092124 run patchelf(pid=12852): Launched 13:51:19.268725 run osmo-stp_10.42.42.5(pid=12849): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12849)] 13:51:19.403937 run osmo-stp_10.42.42.5(pid=12849): stdout: | (launched: 2022-12-09_13:51:17.977930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:19.540020 run osmo-stp_10.42.42.5(pid=12849): stderr: | 20221209135118167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135118167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135118168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135118168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135118169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135118170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135118170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:19.676682 run osmo-stp_10.42.42.5(pid=12849): stdout: | (launched: 2022-12-09_13:51:17.977930) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:19.807243 run osmo-stp_10.42.42.5(pid=12849): stderr: | 20221209135118167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135118167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135118168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135118168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135118169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135118170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135118170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:19.962362 run patchelf(pid=12852): Terminating (SIGINT) 13:51:20.139687 run patchelf(pid=12852): Terminated: ok {rc=0} 13:51:20.267632 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12849): Process ended prematurely: osmo-stp_10.42.42.5(pid=12849) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12849)] [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 13:51:20.277308 tst ping.py:22: Test FAILED (6.8 sec) 13:51:20.305969 run osmo-hlr_10.42.42.2(pid=12846): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12846)] 13:51:20.356557 run osmo-hlr_10.42.42.2(pid=12846): stdout: | (launched: 2022-12-09_13:51:16.843989) 13:51:20.408706 run osmo-hlr_10.42.42.2(pid=12846): stderr: | 20221209135117138 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135117138 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135117138 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135117138 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135117138 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135117138 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135117151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135117163 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135117164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135117164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:20.461472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12845): Terminating (SIGTERM) 13:51:20.503721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12848): Terminating (SIGTERM) 13:51:20.546233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12851): Terminating (SIGTERM) 13:51:20.588705 --- ParallelTerminationStrategy: PID 12845 died... 13:51:20.608997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12845): Terminated: ok {rc=0} 13:51:20.656227 --- ParallelTerminationStrategy: PID 12848 died... 13:51:20.676104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12848): Terminated: ok {rc=0} 13:51:20.722790 --- ParallelTerminationStrategy: PID 12851 died... 13:51:20.742710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12851): Terminated: ok {rc=0} 13:51:20.831042 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:51:21.919198 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:21.931626 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:51:21.974576 tst ping_idle_ping.py: using LAC 21899 13:51:22.099480 tst ping_idle_ping.py: using RAC 224 13:51:22.221735 tst ping_idle_ping.py: using CellId 21899 13:51:22.346833 tst ping_idle_ping.py: using BVCI 21900 13:51:22.461707 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:22.473274 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:22.484454 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:22.496041 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:22.507582 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:22.519111 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:22.530762 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:22.542240 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:51:22.660428 tst ping_idle_ping.py:24: start network... 13:51:22.873971 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:23.374167 run create_hlr_db(pid=12853): Launched 13:51:23.494504 bus /gobi_6: Setting Powered False 13:51:24.557232 run create_hlr_db(pid=12853): Terminated: ok {rc=0} 13:51:24.983560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12855): Launched 13:51:25.281204 run osmo-hlr_10.42.42.2(pid=12856): Launched 13:51:25.395122 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:25.908494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12858): Launched 13:51:26.205218 run osmo-stp_10.42.42.5(pid=12859): Launched 13:51:26.318022 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:26.830768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12861): Launched 13:51:26.943566 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:27.194301 run patchelf(pid=12862): Launched 13:51:27.358938 run osmo-stp_10.42.42.5(pid=12859): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12859)] 13:51:27.484675 run osmo-stp_10.42.42.5(pid=12859): stdout: | (launched: 2022-12-09_13:51:26.149928) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:27.612636 run osmo-stp_10.42.42.5(pid=12859): stderr: | 20221209135126319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135126320 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135126320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135126320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135126321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135126321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135126321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:27.740155 run osmo-stp_10.42.42.5(pid=12859): stdout: | (launched: 2022-12-09_13:51:26.149928) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:27.861766 run osmo-stp_10.42.42.5(pid=12859): stderr: | 20221209135126319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135126320 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135126320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135126320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135126321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135126321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135126321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:28.006221 run patchelf(pid=12862): Terminating (SIGINT) 13:51:28.172923 run patchelf(pid=12862): Terminated: ok {rc=0} 13:51:28.292685 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12859): Process ended prematurely: osmo-stp_10.42.42.5(pid=12859) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12859)] [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 13:51:28.301665 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:51:28.328107 run osmo-hlr_10.42.42.2(pid=12856): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12856)] 13:51:28.375461 run osmo-hlr_10.42.42.2(pid=12856): stdout: | (launched: 2022-12-09_13:51:25.226387) 13:51:28.424382 run osmo-hlr_10.42.42.2(pid=12856): stderr: | 20221209135125400 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135125400 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135125400 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135125400 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135125400 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135125400 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135125412 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135125421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135125422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135125422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:28.473826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12855): Terminating (SIGTERM) 13:51:28.513383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12858): Terminating (SIGTERM) 13:51:28.553134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12861): Terminating (SIGTERM) 13:51:28.592873 --- ParallelTerminationStrategy: PID 12855 died... 13:51:28.611979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12855): Terminated: ok {rc=0} 13:51:28.655721 --- ParallelTerminationStrategy: PID 12858 died... 13:51:28.674429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12858): Terminated: ok {rc=0} 13:51:28.717856 --- ParallelTerminationStrategy: PID 12861 died... 13:51:28.736421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12861): Terminated: ok {rc=0} 13:51:28.821297 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:51:30.119978 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:51:30.127020 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:51:30.150920 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:51:30.189579 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:51:30.276935 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:51:30.301138 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:51:30.338953 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:51:30.945421 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:51:30.994506 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:31.005658 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:51:31.065142 tst cs_paging_gprs_active.py: using LAC 21900 13:51:31.233310 tst cs_paging_gprs_active.py: using RAC 225 13:51:31.362142 tst cs_paging_gprs_active.py: using CellId 21900 13:51:31.530932 tst cs_paging_gprs_active.py: using BVCI 21901 13:51:31.645918 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:31.657693 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:31.669179 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:31.680579 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:31.691958 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:31.703307 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:31.714811 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:31.726505 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:31.738310 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:31.876145 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:32.029550 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:51:32.319599 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:32.647396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12868): Launched 13:51:32.929412 run iperf3-srv_10.42.42.10(pid=12869): Launched 13:51:33.051623 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:51:33.269165 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:33.593252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12870): Launched 13:51:33.873718 run iperf3-srv_10.42.42.10(pid=12871): Launched 13:51:33.995125 tst cs_paging_gprs_active.py:38: start network... 13:51:34.212064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:34.713666 run create_hlr_db(pid=12872): Launched 13:51:34.835985 bus /gobi_6: Setting Powered False 13:51:35.900150 run create_hlr_db(pid=12872): Terminated: ok {rc=0} 13:51:36.332649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12874): Launched 13:51:36.635904 run osmo-hlr_10.42.42.2(pid=12875): Launched 13:51:36.752664 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:37.274227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12877): Launched 13:51:37.576863 run osmo-stp_10.42.42.5(pid=12878): Launched 13:51:37.701308 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:38.259166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12880): Launched 13:51:38.382998 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:38.655203 run patchelf(pid=12881): Launched 13:51:38.834699 run osmo-stp_10.42.42.5(pid=12878): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12878)] 13:51:38.971647 run osmo-stp_10.42.42.5(pid=12878): stdout: | (launched: 2022-12-09_13:51:37.520278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:39.110073 run osmo-stp_10.42.42.5(pid=12878): stderr: | 20221209135137706 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135137707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135137707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135137707 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135137708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135137708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135137708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:39.247950 run osmo-stp_10.42.42.5(pid=12878): stdout: | (launched: 2022-12-09_13:51:37.520278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:39.380489 run osmo-stp_10.42.42.5(pid=12878): stderr: | 20221209135137706 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135137707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135137707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135137707 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135137708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135137708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135137708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:39.537118 run patchelf(pid=12881): Terminating (SIGINT) 13:51:39.716562 run patchelf(pid=12881): Terminated: ok {rc=0} 13:51:39.846721 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12878): Process ended prematurely: osmo-stp_10.42.42.5(pid=12878) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12878)] [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:51:39.856924 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:51:39.886207 run osmo-hlr_10.42.42.2(pid=12875): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12875)] 13:51:39.936475 run osmo-hlr_10.42.42.2(pid=12875): stdout: | (launched: 2022-12-09_13:51:36.580102) 13:51:39.989313 run osmo-hlr_10.42.42.2(pid=12875): stderr: | 20221209135136754 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135136754 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135136755 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135136755 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135136755 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135136755 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135136771 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135136782 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135136782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135136782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:40.041950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12868): Terminating (SIGTERM) 13:51:40.084530 run iperf3-srv_10.42.42.10(pid=12869): Terminating (SIGTERM) 13:51:40.126799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12870): Terminating (SIGTERM) 13:51:40.169152 run iperf3-srv_10.42.42.10(pid=12871): Terminating (SIGTERM) 13:51:40.211448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12874): Terminating (SIGTERM) 13:51:40.253824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12877): Terminating (SIGTERM) 13:51:40.296035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12880): Terminating (SIGTERM) 13:51:40.338641 --- ParallelTerminationStrategy: PID 12868 died... 13:51:40.359224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12868): Terminated: ok {rc=0} 13:51:40.406101 --- ParallelTerminationStrategy: PID 12869 died... 13:51:40.425676 run iperf3-srv_10.42.42.10(pid=12869): Terminated {rc=256} 13:51:40.472121 --- ParallelTerminationStrategy: PID 12870 died... 13:51:40.491665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12870): Terminated: ok {rc=0} 13:51:40.538101 --- ParallelTerminationStrategy: PID 12871 died... 13:51:40.557604 run iperf3-srv_10.42.42.10(pid=12871): Terminated {rc=256} 13:51:40.604239 --- ParallelTerminationStrategy: PID 12874 died... 13:51:40.623784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12874): Terminated: ok {rc=0} 13:51:40.670185 --- ParallelTerminationStrategy: PID 12877 died... 13:51:40.689841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12877): Terminated: ok {rc=0} 13:51:40.736365 --- ParallelTerminationStrategy: PID 12880 died... 13:51:40.755991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12880): Terminated: ok {rc=0} 13:51:40.843976 bus /gobi_0: Setting Powered False 13:51:41.944452 bus /gobi_0: Setting Powered False 13:51:43.061262 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:51:44.205033 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:44.216610 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:51:44.279147 tst iperf3.py: using LAC 21901 13:51:44.396788 tst iperf3.py: using RAC 226 13:51:44.515313 tst iperf3.py: using CellId 21901 13:51:44.637724 tst iperf3.py: using BVCI 21902 13:51:44.748181 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:44.759421 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:44.770451 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:44.781541 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:44.792389 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:44.803401 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:44.814523 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:44.825448 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:44.836588 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:44.956610 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:51:45.174614 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:45.498305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12882): Launched 13:51:45.778841 run iperf3-srv_10.42.42.10(pid=12883): Launched 13:51:45.918745 tst iperf3.py:8: start network... 13:51:46.139984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:46.649424 run create_hlr_db(pid=12884): Launched 13:51:46.813006 bus /gobi_6: Setting Powered False 13:51:47.877034 run create_hlr_db(pid=12884): Terminated: ok {rc=0} 13:51:48.308367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12886): Launched 13:51:48.610939 run osmo-hlr_10.42.42.2(pid=12887): Launched 13:51:48.726617 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:49.266136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12889): Launched 13:51:49.567649 run osmo-stp_10.42.42.5(pid=12890): Launched 13:51:49.682281 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:50.203770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12892): Launched 13:51:50.319128 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:50.574567 run patchelf(pid=12893): Launched 13:51:50.741244 run osmo-stp_10.42.42.5(pid=12890): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12890)] 13:51:50.868519 run osmo-stp_10.42.42.5(pid=12890): stdout: | (launched: 2022-12-09_13:51:49.511719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:50.997283 run osmo-stp_10.42.42.5(pid=12890): stderr: | 20221209135149684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135149685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135149685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135149685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135149686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135149686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135149686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:51.126153 run osmo-stp_10.42.42.5(pid=12890): stdout: | (launched: 2022-12-09_13:51:49.511719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:51.250351 run osmo-stp_10.42.42.5(pid=12890): stderr: | 20221209135149684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135149685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135149685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135149685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135149686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135149686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135149686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:51.396342 run patchelf(pid=12893): Terminating (SIGINT) 13:51:51.564527 run patchelf(pid=12893): Terminated: ok {rc=0} 13:51:51.685739 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12890): Process ended prematurely: osmo-stp_10.42.42.5(pid=12890) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12890)] [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 13:51:51.695127 tst iperf3.py:8: Test FAILED (7.5 sec) 13:51:51.722046 run osmo-hlr_10.42.42.2(pid=12887): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12887)] 13:51:51.769224 run osmo-hlr_10.42.42.2(pid=12887): stdout: | (launched: 2022-12-09_13:51:48.555565) 13:51:51.818326 run osmo-hlr_10.42.42.2(pid=12887): stderr: | 20221209135148733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135148733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135148733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135148733 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135148733 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135148733 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135148744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135148752 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135148753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135148753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:51.867828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12882): Terminating (SIGTERM) 13:51:51.907315 run iperf3-srv_10.42.42.10(pid=12883): Terminating (SIGTERM) 13:51:51.946809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12886): Terminating (SIGTERM) 13:51:51.986287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12889): Terminating (SIGTERM) 13:51:52.025740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12892): Terminating (SIGTERM) 13:51:52.065619 --- ParallelTerminationStrategy: PID 12882 died... 13:51:52.084738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12882): Terminated: ok {rc=0} 13:51:52.128861 --- ParallelTerminationStrategy: PID 12883 died... 13:51:52.147585 run iperf3-srv_10.42.42.10(pid=12883): Terminated {rc=256} 13:51:52.191087 --- ParallelTerminationStrategy: PID 12886 died... 13:51:52.209593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12886): Terminated: ok {rc=0} 13:51:52.252895 --- ParallelTerminationStrategy: PID 12889 died... 13:51:52.271893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12889): Terminated: ok {rc=0} 13:51:52.315238 --- ParallelTerminationStrategy: PID 12892 died... 13:51:52.333897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12892): Terminated: ok {rc=0} 13:51:52.418698 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:51:53.565974 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:53.577801 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:51:53.638938 tst iperf3m4.py: using LAC 21902 13:51:53.758548 tst iperf3m4.py: using RAC 227 13:51:53.877071 tst iperf3m4.py: using CellId 21902 13:51:53.997413 tst iperf3m4.py: using BVCI 21903 13:51:54.106935 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:54.118093 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:54.128886 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:54.139763 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:54.150511 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:54.161724 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:54.172575 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:54.183328 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:54.194246 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:54.313306 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:54.431700 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:54.552448 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:54.671420 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:51:54.874840 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:55.179681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12894): Launched 13:51:55.444254 run iperf3-srv_10.42.42.10(pid=12895): Launched 13:51:55.557494 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:51:55.758654 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:56.061332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12896): Launched 13:51:56.323376 run iperf3-srv_10.42.42.10(pid=12897): Launched 13:51:56.436183 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:51:56.636380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:56.938219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12898): Launched 13:51:57.200125 run iperf3-srv_10.42.42.10(pid=12899): Launched 13:51:57.313429 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:51:57.513631 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:57.815922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12900): Launched 13:51:58.077828 run iperf3-srv_10.42.42.10(pid=12901): Launched 13:51:58.190208 tst iperf3m4.py:8: start network... 13:51:58.390797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:58.857923 run create_hlr_db(pid=12902): Launched 13:51:58.980414 bus /gobi_6: Setting Powered False 13:52:00.044525 run create_hlr_db(pid=12902): Terminated: ok {rc=0} 13:52:00.475038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12904): Launched 13:52:00.776869 run osmo-hlr_10.42.42.2(pid=12905): Launched 13:52:01.040342 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:01.575082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12907): Launched 13:52:01.901672 run osmo-stp_10.42.42.5(pid=12908): Launched 13:52:02.152597 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:02.776545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12910): Launched 13:52:02.899287 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:03.172115 run patchelf(pid=12911): Launched 13:52:03.343882 run osmo-stp_10.42.42.5(pid=12908): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12908)] 13:52:03.471697 run osmo-stp_10.42.42.5(pid=12908): stdout: | (launched: 2022-12-09_13:52:01.836814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:03.601273 run osmo-stp_10.42.42.5(pid=12908): stderr: | 20221209135202071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135202071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135202071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135202072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135202072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135202072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135202072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:03.730401 run osmo-stp_10.42.42.5(pid=12908): stdout: | (launched: 2022-12-09_13:52:01.836814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:03.854188 run osmo-stp_10.42.42.5(pid=12908): stderr: | 20221209135202071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135202071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135202071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135202072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135202072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135202072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135202072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:04.000478 run patchelf(pid=12911): Terminating (SIGINT) 13:52:04.169483 run patchelf(pid=12911): Terminated: ok {rc=0} 13:52:04.290548 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12908): Process ended prematurely: osmo-stp_10.42.42.5(pid=12908) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12908)] [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:52:04.299944 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:52:04.327352 run osmo-hlr_10.42.42.2(pid=12905): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12905)] 13:52:04.374731 run osmo-hlr_10.42.42.2(pid=12905): stdout: | (launched: 2022-12-09_13:52:00.720231) 13:52:04.423699 run osmo-hlr_10.42.42.2(pid=12905): stderr: | 20221209135200896 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135200896 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135200896 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135200896 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135200896 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135200896 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135200911 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135200920 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135200920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135200920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:04.472856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12894): Terminating (SIGTERM) 13:52:04.512595 run iperf3-srv_10.42.42.10(pid=12895): Terminating (SIGTERM) 13:52:04.552661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12896): Terminating (SIGTERM) 13:52:04.592373 run iperf3-srv_10.42.42.10(pid=12897): Terminating (SIGTERM) 13:52:04.632181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12898): Terminating (SIGTERM) 13:52:04.672069 run iperf3-srv_10.42.42.10(pid=12899): Terminating (SIGTERM) 13:52:04.711937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12900): Terminating (SIGTERM) 13:52:04.751798 run iperf3-srv_10.42.42.10(pid=12901): Terminating (SIGTERM) 13:52:04.791584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12904): Terminating (SIGTERM) 13:52:04.831542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12907): Terminating (SIGTERM) 13:52:04.871323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12910): Terminating (SIGTERM) 13:52:04.911570 --- ParallelTerminationStrategy: PID 12894 died... 13:52:04.930902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12894): Terminated: ok {rc=0} 13:52:04.974960 --- ParallelTerminationStrategy: PID 12895 died... 13:52:04.993445 run iperf3-srv_10.42.42.10(pid=12895): Terminated {rc=256} 13:52:05.037434 --- ParallelTerminationStrategy: PID 12896 died... 13:52:05.056232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12896): Terminated: ok {rc=0} 13:52:05.099913 --- ParallelTerminationStrategy: PID 12897 died... 13:52:05.118662 run iperf3-srv_10.42.42.10(pid=12897): Terminated {rc=256} 13:52:05.162375 --- ParallelTerminationStrategy: PID 12898 died... 13:52:05.181170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12898): Terminated: ok {rc=0} 13:52:05.224614 --- ParallelTerminationStrategy: PID 12899 died... 13:52:05.243318 run iperf3-srv_10.42.42.10(pid=12899): Terminated {rc=256} 13:52:05.286805 --- ParallelTerminationStrategy: PID 12900 died... 13:52:05.306151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12900): Terminated: ok {rc=0} 13:52:05.349988 --- ParallelTerminationStrategy: PID 12901 died... 13:52:05.368644 run iperf3-srv_10.42.42.10(pid=12901): Terminated {rc=256} 13:52:05.412295 --- ParallelTerminationStrategy: PID 12904 died... 13:52:05.431062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12904): Terminated: ok {rc=0} 13:52:05.474608 --- ParallelTerminationStrategy: PID 12907 died... 13:52:05.493443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12907): Terminated: ok {rc=0} 13:52:05.537105 --- ParallelTerminationStrategy: PID 12910 died... 13:52:05.555921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12910): Terminated: ok {rc=0} 13:52:05.640866 bus /gobi_4: Setting Powered False 13:52:06.741378 bus /gobi_4: Setting Powered False 13:52:07.857083 bus /gobi_1: Setting Powered False 13:52:08.957491 bus /gobi_1: Setting Powered False 13:52:10.075922 bus /gobi_0: Setting Powered False 13:52:11.174765 bus /gobi_0: Setting Powered False 13:52:12.290504 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:52:13.395850 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:13.407440 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:52:13.468709 tst ping.py: using LAC 21903 13:52:13.586958 tst ping.py: using RAC 228 13:52:13.704430 tst ping.py: using CellId 21903 13:52:13.829239 tst ping.py: using BVCI 21904 13:52:13.943850 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:13.955682 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:13.967654 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:13.980362 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:13.992211 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:14.003919 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:14.016005 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:14.028261 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:52:14.143433 tst ping.py:19: start network... 13:52:14.340746 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:14.799387 run create_hlr_db(pid=12912): Launched 13:52:14.922019 bus /gobi_6: Setting Powered False 13:52:15.992320 run create_hlr_db(pid=12912): Terminated: ok {rc=0} 13:52:16.471527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12914): Launched 13:52:16.782382 run osmo-hlr_10.42.42.2(pid=12915): Launched 13:52:17.010716 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:17.729401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12917): Launched 13:52:18.045682 run osmo-stp_10.42.42.5(pid=12918): Launched 13:52:18.166173 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:18.710515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12920): Launched 13:52:18.831186 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:19.098541 run patchelf(pid=12921): Launched 13:52:19.274287 run osmo-stp_10.42.42.5(pid=12918): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12918)] 13:52:19.408474 run osmo-stp_10.42.42.5(pid=12918): stdout: | (launched: 2022-12-09_13:52:17.987752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:19.544292 run osmo-stp_10.42.42.5(pid=12918): stderr: | 20221209135218179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135218179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135218179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135218180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135218180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135218180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135218180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:19.679907 run osmo-stp_10.42.42.5(pid=12918): stdout: | (launched: 2022-12-09_13:52:17.987752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:19.809500 run osmo-stp_10.42.42.5(pid=12918): stderr: | 20221209135218179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135218179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135218179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135218180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135218180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135218180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135218180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:19.963518 run patchelf(pid=12921): Terminating (SIGINT) 13:52:20.140475 run patchelf(pid=12921): Terminated: ok {rc=0} 13:52:20.268023 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12918): Process ended prematurely: osmo-stp_10.42.42.5(pid=12918) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12918)] [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 13:52:20.277680 tst ping.py:22: Test FAILED (6.9 sec) 13:52:20.306377 run osmo-hlr_10.42.42.2(pid=12915): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12915)] 13:52:20.356511 run osmo-hlr_10.42.42.2(pid=12915): stdout: | (launched: 2022-12-09_13:52:16.723336) 13:52:20.408371 run osmo-hlr_10.42.42.2(pid=12915): stderr: | 20221209135217043 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135217043 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135217043 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135217043 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135217043 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135217043 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135217056 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135217071 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135217072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135217072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:20.460356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12914): Terminating (SIGTERM) 13:52:20.502503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12917): Terminating (SIGTERM) 13:52:20.544505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12920): Terminating (SIGTERM) 13:52:20.586972 --- ParallelTerminationStrategy: PID 12914 died... 13:52:20.607049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12914): Terminated: ok {rc=0} 13:52:20.653663 --- ParallelTerminationStrategy: PID 12917 died... 13:52:20.673278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12917): Terminated: ok {rc=0} 13:52:20.719439 --- ParallelTerminationStrategy: PID 12920 died... 13:52:20.739016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12920): Terminated: ok {rc=0} 13:52:20.826383 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:52:21.914374 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:21.926956 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:52:21.991365 tst ping_idle_ping.py: using LAC 21904 13:52:22.117111 tst ping_idle_ping.py: using RAC 229 13:52:22.240934 tst ping_idle_ping.py: using CellId 21904 13:52:22.365130 tst ping_idle_ping.py: using BVCI 21905 13:52:22.481648 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:22.493415 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:22.504614 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:22.516357 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:22.527862 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:22.539528 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:22.551200 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:22.562939 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:52:22.681866 tst ping_idle_ping.py:24: start network... 13:52:22.894795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:23.387578 run create_hlr_db(pid=12922): Launched 13:52:23.508146 bus /gobi_6: Setting Powered False 13:52:24.570222 run create_hlr_db(pid=12922): Terminated: ok {rc=0} 13:52:24.995782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12924): Launched 13:52:25.291689 run osmo-hlr_10.42.42.2(pid=12925): Launched 13:52:25.404577 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:25.913705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12927): Launched 13:52:26.209234 run osmo-stp_10.42.42.5(pid=12928): Launched 13:52:26.321799 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:26.833688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12930): Launched 13:52:26.947055 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:27.197426 run patchelf(pid=12931): Launched 13:52:27.361894 run osmo-stp_10.42.42.5(pid=12928): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12928)] 13:52:27.487812 run osmo-stp_10.42.42.5(pid=12928): stdout: | (launched: 2022-12-09_13:52:26.154301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:27.614946 run osmo-stp_10.42.42.5(pid=12928): stderr: | 20221209135226325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135226325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135226325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135226326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135226326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135226326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135226326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:27.741782 run osmo-stp_10.42.42.5(pid=12928): stdout: | (launched: 2022-12-09_13:52:26.154301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:27.863132 run osmo-stp_10.42.42.5(pid=12928): stderr: | 20221209135226325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135226325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135226325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135226326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135226326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135226326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135226326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:28.006816 run patchelf(pid=12931): Terminating (SIGINT) 13:52:28.172750 run patchelf(pid=12931): Terminated: ok {rc=0} 13:52:28.292315 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12928): Process ended prematurely: osmo-stp_10.42.42.5(pid=12928) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12928)] [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:52:28.301246 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:52:28.327922 run osmo-hlr_10.42.42.2(pid=12925): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12925)] 13:52:28.375273 run osmo-hlr_10.42.42.2(pid=12925): stdout: | (launched: 2022-12-09_13:52:25.236903) 13:52:28.425051 run osmo-hlr_10.42.42.2(pid=12925): stderr: | 20221209135225413 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135225413 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135225413 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135225413 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135225413 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135225413 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135225425 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135225434 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135225435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135225435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:28.474651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12924): Terminating (SIGTERM) 13:52:28.514345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12927): Terminating (SIGTERM) 13:52:28.554303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12930): Terminating (SIGTERM) 13:52:28.594290 --- ParallelTerminationStrategy: PID 12924 died... 13:52:28.613440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12924): Terminated: ok {rc=0} 13:52:28.657400 --- ParallelTerminationStrategy: PID 12927 died... 13:52:28.676120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12927): Terminated: ok {rc=0} 13:52:28.720359 --- ParallelTerminationStrategy: PID 12930 died... 13:52:28.739234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12930): Terminated: ok {rc=0} 13:52:28.824215 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 13:52:30.122679 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:52:30.130586 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:52:30.154697 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:52:30.188892 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:52:30.241781 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:52:30.265109 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:52:30.298804 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:52:30.870266 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2360 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:52:30.875807 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:52:30.892224 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:52:30.967779 tst switch_tch_pdch.py: using LAC 21905 13:52:31.097357 tst switch_tch_pdch.py: using RAC 230 13:52:31.249740 tst switch_tch_pdch.py: using CellId 21905 13:52:31.370760 tst switch_tch_pdch.py: using BVCI 21906 13:52:31.478850 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:52:31.491048 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:52:31.503422 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:52:31.515383 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:52:31.527276 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:52:31.539241 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:52:31.551194 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:52:31.566773 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:52:31.712148 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:52:31.845166 tst switch_tch_pdch.py:51: start network... 13:52:32.066882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:32.564706 run create_hlr_db(pid=12935): Launched 13:52:32.686472 bus /gobi_6: Setting Powered False 13:52:33.749499 run create_hlr_db(pid=12935): Terminated: ok {rc=0} 13:52:34.191282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12938): Launched 13:52:34.507374 run osmo-hlr_10.42.42.2(pid=12939): Launched 13:52:34.627336 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:35.173810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12941): Launched 13:52:35.489364 run osmo-stp_10.42.42.5(pid=12942): Launched 13:52:35.610098 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:36.141132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12944): Launched 13:52:36.254970 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:36.506494 run patchelf(pid=12945): Launched 13:52:36.672352 run osmo-stp_10.42.42.5(pid=12942): ERR: Terminated: ERROR {rc=1} [trial-2360↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12942)] 13:52:36.798539 run osmo-stp_10.42.42.5(pid=12942): stdout: | (launched: 2022-12-09_13:52:35.431515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:36.926101 run osmo-stp_10.42.42.5(pid=12942): stderr: | 20221209135235624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135235624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135235624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135235625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135235625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135235626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135235626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:37.053702 run osmo-stp_10.42.42.5(pid=12942): stdout: | (launched: 2022-12-09_13:52:35.431515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:37.175576 run osmo-stp_10.42.42.5(pid=12942): stderr: | 20221209135235624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135235624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135235624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135235625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135235625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135235626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135235626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:37.319774 run patchelf(pid=12945): Terminating (SIGINT) 13:52:37.485427 run patchelf(pid=12945): Terminated: ok {rc=0} 13:52:37.605653 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12942): Process ended prematurely: osmo-stp_10.42.42.5(pid=12942) [trial-2360↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12942)] [trial-2360↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:52:37.614669 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 13:52:37.641034 run osmo-hlr_10.42.42.2(pid=12939): ERR: Terminated: ERROR {rc=237} [trial-2360↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12939)] 13:52:37.688738 run osmo-hlr_10.42.42.2(pid=12939): stdout: | (launched: 2022-12-09_13:52:34.449453) 13:52:37.737925 run osmo-hlr_10.42.42.2(pid=12939): stderr: | 20221209135234648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135234648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135234648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135234648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135234648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135234648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135234660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135234669 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135234669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135234669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:37.787476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12938): Terminating (SIGTERM) 13:52:37.827912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12941): Terminating (SIGTERM) 13:52:37.867891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12944): Terminating (SIGTERM) 13:52:37.908079 --- ParallelTerminationStrategy: PID 12938 died... 13:52:37.927251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12938): Terminated: ok {rc=0} 13:52:37.971615 --- ParallelTerminationStrategy: PID 12941 died... 13:52:37.990521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12941): Terminated: ok {rc=0} 13:52:38.034450 --- ParallelTerminationStrategy: PID 12944 died... 13:52:38.053259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12944): Terminated: ok {rc=0} 13:52:38.136897 bus /gobi_0: Setting Powered False 13:52:39.234710 bus /gobi_0: Setting Powered False 13:52:40.355059 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 sms:nanobts+band-900 --------------------------------------------------------------------- 13:52:41.603134 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:52:41.609251 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 13:52:41.642200 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 13:52:41.668882 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 13:52:41.719423 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 13:52:41.751066 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 13:52:41.777369 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 13:52:42.326641 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 13:52:42.331773 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:52:42.342465 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 13:52:42.388377 tst mo_mt_sms.py: using LAC 21906 13:52:42.502305 tst mo_mt_sms.py: using RAC 231 13:52:42.616341 tst mo_mt_sms.py: using CellId 21906 13:52:42.730546 tst mo_mt_sms.py: using BVCI 21907 13:52:42.836608 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:52:42.847249 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:52:42.857822 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:52:42.868173 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:52:42.878939 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:52:42.889310 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 13:52:43.006722 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 13:52:43.123474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:43.582970 run create_hlr_db(pid=12949): Launched 13:52:43.704173 bus /gobi_6: Setting Powered False 13:52:44.763682 run create_hlr_db(pid=12949): Terminated: ok {rc=0} 13:52:45.196922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12951): Launched 13:52:45.513267 run osmo-hlr_10.42.42.2(pid=12952): Launched 13:52:45.634171 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:46.203708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12954): Launched 13:52:46.534724 run osmo-stp_10.42.42.5(pid=12955): Launched 13:52:46.771683 run osmo-msc_10.42.42.6: Starting osmo-msc 13:52:47.404536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12957): Launched 13:52:47.722062 run osmo-msc_10.42.42.6(pid=12958): Launched 13:52:47.898797 run osmo-stp_10.42.42.5(pid=12955): ERR: Terminated: ERROR {rc=1} [trial-2360↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12955)] 13:52:48.033426 run osmo-stp_10.42.42.5(pid=12955): stdout: | (launched: 2022-12-09_13:52:46.474497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:48.168152 run osmo-stp_10.42.42.5(pid=12955): stderr: | 20221209135246775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135246775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135246776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135246776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135246776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135246776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135246785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:48.302537 run osmo-stp_10.42.42.5(pid=12955): stdout: | (launched: 2022-12-09_13:52:46.474497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:48.428470 run osmo-stp_10.42.42.5(pid=12955): stderr: | 20221209135246775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135246775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135246776 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135246776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135246776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135246776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135246785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:48.579469 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12955): Process ended prematurely: osmo-stp_10.42.42.5(pid=12955) [trial-2360↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12955)] [trial-2360↪sms:nanobts+band-900↪mo_mt_sms.py:16] 13:52:48.588752 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 13:52:48.616782 run osmo-hlr_10.42.42.2(pid=12952): ERR: Terminated: ERROR {rc=237} [trial-2360↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12952)] 13:52:48.667017 run osmo-hlr_10.42.42.2(pid=12952): stdout: | (launched: 2022-12-09_13:52:45.455277) 13:52:48.719293 run osmo-hlr_10.42.42.2(pid=12952): stderr: | 20221209135245655 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135245655 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135245655 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135245655 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135245655 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135245656 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135245668 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135245676 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135245676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135245676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:48.791571 run osmo-msc_10.42.42.6(pid=12958): ERR: Terminated: ERROR {rc=2} [trial-2360↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12958)] 13:52:48.841630 run osmo-msc_10.42.42.6(pid=12958): stdout: | (launched: 2022-12-09_13:52:47.663726) 13:52:48.893303 run osmo-msc_10.42.42.6(pid=12958): stderr: | 20221209135247985 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209135247986 DLGLOBAL DEBUG validating counter group 0x7f030207ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209135247986 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209135247986 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209135247986 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209135247986 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209135247988 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209135247988 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209135247988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209135247988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:52:48.945446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12951): Terminating (SIGTERM) 13:52:48.987837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12954): Terminating (SIGTERM) 13:52:49.029971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12957): Terminating (SIGTERM) 13:52:49.072084 --- ParallelTerminationStrategy: PID 12951 died... 13:52:49.092136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12951): Terminated: ok {rc=0} 13:52:49.138636 --- ParallelTerminationStrategy: PID 12954 died... 13:52:49.158222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12954): Terminated: ok {rc=0} 13:52:49.204620 --- ParallelTerminationStrategy: PID 12957 died... 13:52:49.224218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12957): Terminated: ok {rc=0} 13:52:49.312893 bus /sierra_3: Setting Powered False 13:52:50.411855 bus /sierra_3: Setting Powered False 13:52:51.528038 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 13:52:52.764735 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:52:52.769840 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 13:52:52.803192 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 13:52:52.810955 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 13:52:52.850976 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 13:52:52.886340 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 13:52:52.893303 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 13:52:53.405523 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2360 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 13:52:53.411270 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 13:52:53.422634 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 13:52:53.468386 tst assert_extension.py: using LAC 21907 13:52:53.582662 tst assert_extension.py: using RAC 232 13:52:53.707799 tst assert_extension.py: using CellId 21907 13:52:53.832266 tst assert_extension.py: using BVCI 21908 13:52:53.948270 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 13:52:54.063747 tst assert_extension.py:10: start nitb and bts... 13:52:54.261364 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:52:54.866845 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12964): Launched 13:52:55.162330 run osmo-nitb_10.42.42.2(pid=12965): Launched 13:52:55.325360 run osmo-nitb_10.42.42.2(pid=12965): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12965)] 13:52:55.458659 run osmo-nitb_10.42.42.2(pid=12965): stdout: | (launched: 2022-12-09_13:52:55.107528) 13:52:55.593467 run osmo-nitb_10.42.42.2(pid=12965): stderr: | (launched: 2022-12-09_13:52:55.151787) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:52:55.728734 run osmo-nitb_10.42.42.2(pid=12965): stdout: | (launched: 2022-12-09_13:52:55.107528) 13:52:55.858079 run osmo-nitb_10.42.42.2(pid=12965): stderr: | (launched: 2022-12-09_13:52:55.151787) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12965): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12965) [trial-2360↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12965)] 13:52:56.273209 tst osmo-nitb_10.42.42.2(pid=12965): stdout: | (launched: 2022-12-09_13:52:55.107528) 13:52:56.392138 tst osmo-nitb_10.42.42.2(pid=12965): stderr: | (launched: 2022-12-09_13:52:55.151787) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:52:56.532909 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12965): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12965) [trial-2360↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12965)] [trial-2360↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 13:52:56.541550 tst assert_extension.py:12: Test FAILED (3.1 sec) 13:52:56.548182 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12964): Terminating (SIGTERM) 13:52:56.756794 --- ParallelTerminationStrategy: PID 12964 died... 13:52:56.777525 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12964): Terminated: ok {rc=0} 13:52:56.863236 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 ussd:nanobts+band-900 --------------------------------------------------------------------- 13:52:58.039110 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:52:58.043860 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 13:52:58.076513 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 13:52:58.102935 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 13:52:58.139166 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 13:52:58.172652 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 13:52:58.200340 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 13:52:58.725823 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2360 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 13:52:58.730866 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:52:58.741699 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 13:52:58.787005 tst assert_extension.py: using LAC 21908 13:52:58.903594 tst assert_extension.py: using RAC 233 13:52:59.021341 tst assert_extension.py: using CellId 21908 13:52:59.137027 tst assert_extension.py: using BVCI 21909 13:52:59.243583 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:52:59.254197 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:52:59.264639 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:52:59.275080 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:52:59.285536 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:52:59.295865 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 13:52:59.411494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:59.904334 run create_hlr_db(pid=12969): Launched 13:53:00.026121 bus /sierra_2: Setting Powered False 13:53:01.097576 run create_hlr_db(pid=12969): Terminated: ok {rc=0} 13:53:01.559308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12971): Launched 13:53:01.910359 run osmo-hlr_10.42.42.2(pid=12981): Launched 13:53:02.204007 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:02.925761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13034): Launched 13:53:03.331702 run osmo-stp_10.42.42.5(pid=13071): Launched 13:53:03.590341 run osmo-msc_10.42.42.6: Starting osmo-msc 13:53:04.453594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13224): Launched 13:53:04.814131 run osmo-msc_10.42.42.6(pid=13247): Launched 13:53:05.029428 run osmo-stp_10.42.42.5(pid=13071): ERR: Terminated: ERROR {rc=1} [trial-2360↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13071)] 13:53:05.286967 run osmo-stp_10.42.42.5(pid=13071): stdout: | (launched: 2022-12-09_13:53:03.262140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:05.555888 run osmo-stp_10.42.42.5(pid=13071): stderr: | 20221209135303606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135303606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135303606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135303606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135303607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135303607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135303607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:05.794472 run osmo-stp_10.42.42.5(pid=13071): stdout: | (launched: 2022-12-09_13:53:03.262140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:05.914043 run osmo-stp_10.42.42.5(pid=13071): stderr: | 20221209135303606 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135303606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135303606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135303606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135303607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135303607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135303607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:06.059125 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=13071): Process ended prematurely: osmo-stp_10.42.42.5(pid=13071) [trial-2360↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13071)] [trial-2360↪ussd:nanobts+band-900↪assert_extension.py:17] 13:53:06.068116 tst assert_extension.py:17: Test FAILED (7.3 sec) 13:53:06.095452 run osmo-hlr_10.42.42.2(pid=12981): ERR: Terminated: ERROR {rc=237} [trial-2360↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12981)] 13:53:06.144780 run osmo-hlr_10.42.42.2(pid=12981): stdout: | (launched: 2022-12-09_13:53:01.846764) 13:53:06.195650 run osmo-hlr_10.42.42.2(pid=12981): stderr: | 20221209135302181 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135302181 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135302181 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135302181 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135302181 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135302181 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135302197 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135302210 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135302210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135302210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:06.267212 run osmo-msc_10.42.42.6(pid=13247): ERR: Terminated: ERROR {rc=2} [trial-2360↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13247)] 13:53:06.316089 run osmo-msc_10.42.42.6(pid=13247): stdout: | (launched: 2022-12-09_13:53:04.757710) 13:53:06.367487 run osmo-msc_10.42.42.6(pid=13247): stderr: | 20221209135305324 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209135305324 DLGLOBAL DEBUG validating counter group 0x7fa4acd1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209135305324 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209135305324 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209135305324 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209135305324 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209135305334 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209135305335 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209135305335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209135305335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:53:06.418569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12971): Terminating (SIGTERM) 13:53:06.459286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13034): Terminating (SIGTERM) 13:53:06.500818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13224): Terminating (SIGTERM) 13:53:06.544569 --- ParallelTerminationStrategy: PID 12971 died... 13:53:06.564522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12971): Terminated: ok {rc=0} 13:53:06.611426 --- ParallelTerminationStrategy: PID 13034 died... 13:53:06.630942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13034): Terminated: ok {rc=0} 13:53:06.675989 --- ParallelTerminationStrategy: PID 13224 died... 13:53:06.696019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13224): Terminated: ok {rc=0} 13:53:06.781554 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:53:07.991785 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:53:07.999266 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:53:08.033363 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:53:08.061335 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:53:08.111605 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:53:08.145225 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:53:08.172832 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:53:08.723231 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:53:08.774905 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:53:08.786963 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:53:08.853762 tst mo_mt_call.py: using LAC 21909 13:53:08.973018 tst mo_mt_call.py: using RAC 234 13:53:09.100208 tst mo_mt_call.py: using CellId 21909 13:53:09.221968 tst mo_mt_call.py: using BVCI 21910 13:53:09.334551 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:53:09.347167 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:53:09.359311 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:53:09.371368 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:53:09.384839 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:53:09.398424 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:53:09.519100 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:53:09.639947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:10.128234 run create_hlr_db(pid=13254): Launched 13:53:10.290019 bus /sierra_2: Setting Powered False 13:53:11.351574 run create_hlr_db(pid=13254): Terminated: ok {rc=0} 13:53:11.791970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13256): Launched 13:53:12.118191 run osmo-hlr_10.42.42.2(pid=13257): Launched 13:53:12.351192 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:13.068446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13259): Launched 13:53:13.395066 run osmo-stp_10.42.42.5(pid=13260): Launched 13:53:13.632471 run osmo-msc_10.42.42.6: Starting osmo-msc 13:53:14.345049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13262): Launched 13:53:14.673417 run osmo-msc_10.42.42.6(pid=13263): Launched 13:53:15.024769 run osmo-stp_10.42.42.5(pid=13260): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13260)] 13:53:15.291640 run osmo-stp_10.42.42.5(pid=13260): stdout: | (launched: 2022-12-09_13:53:13.333460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:15.575158 run osmo-stp_10.42.42.5(pid=13260): stderr: | 20221209135313663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135313663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135313663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135313664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135313664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135313664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135313664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:15.738805 run osmo-stp_10.42.42.5(pid=13260): stdout: | (launched: 2022-12-09_13:53:13.333460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:15.883019 run osmo-stp_10.42.42.5(pid=13260): stderr: | 20221209135313663 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135313663 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135313663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135313664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135313664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135313664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135313664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:16.061139 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13260): Process ended prematurely: osmo-stp_10.42.42.5(pid=13260) [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13260)] [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:53:16.070763 tst mo_mt_call.py:8: Test FAILED (7.3 sec) 13:53:16.098636 run osmo-hlr_10.42.42.2(pid=13257): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13257)] 13:53:16.147925 run osmo-hlr_10.42.42.2(pid=13257): stdout: | (launched: 2022-12-09_13:53:12.058069) 13:53:16.199840 run osmo-hlr_10.42.42.2(pid=13257): stderr: | 20221209135312394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135312395 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135312395 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135312395 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135312395 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135312395 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135312412 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135312424 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135312424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135312424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:16.295170 run osmo-msc_10.42.42.6(pid=13263): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13263)] 13:53:16.360928 run osmo-msc_10.42.42.6(pid=13263): stdout: | (launched: 2022-12-09_13:53:14.612413) 13:53:16.418754 run osmo-msc_10.42.42.6(pid=13263): stderr: | 20221209135315207 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209135315207 DLGLOBAL DEBUG validating counter group 0x7f8a91fa8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209135315207 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209135315208 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209135315208 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209135315208 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209135315214 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209135315214 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209135315215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209135315215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:53:16.476420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13256): Terminating (SIGTERM) 13:53:16.524013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13259): Terminating (SIGTERM) 13:53:16.574197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13262): Terminating (SIGTERM) 13:53:16.625717 --- ParallelTerminationStrategy: PID 13256 died... 13:53:16.648773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13256): Terminated: ok {rc=0} 13:53:16.702748 --- ParallelTerminationStrategy: PID 13259 died... 13:53:16.725965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13259): Terminated: ok {rc=0} 13:53:16.778258 --- ParallelTerminationStrategy: PID 13262 died... 13:53:16.801294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13262): Terminated: ok {rc=0} 13:53:16.902933 bus /sierra_3: Setting Powered False 13:53:18.015561 bus /sierra_3: Setting Powered False 13:53:19.137847 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:53:20.293793 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:53:20.306870 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:53:20.374838 tst mo_mt_call_osmux.py: using LAC 21910 13:53:20.500023 tst mo_mt_call_osmux.py: using RAC 235 13:53:20.626474 tst mo_mt_call_osmux.py: using CellId 21910 13:53:20.749819 tst mo_mt_call_osmux.py: using BVCI 21911 13:53:20.863922 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:53:20.876469 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:53:20.888562 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:53:20.900494 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:53:20.913436 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:53:20.925397 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:53:21.045319 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:53:21.165821 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:21.658884 run create_hlr_db(pid=13265): Launched 13:53:21.823160 bus /sierra_2: Setting Powered False 13:53:22.884202 run create_hlr_db(pid=13265): Terminated: ok {rc=0} 13:53:23.325920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13267): Launched 13:53:23.656435 run osmo-hlr_10.42.42.2(pid=13268): Launched 13:53:23.906305 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:24.625690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13270): Launched 13:53:24.960039 run osmo-stp_10.42.42.5(pid=13271): Launched 13:53:25.084226 run osmo-msc_10.42.42.6: Starting osmo-msc 13:53:25.669321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13273): Launched 13:53:25.993084 run osmo-msc_10.42.42.6(pid=13274): Launched 13:53:26.165142 run osmo-stp_10.42.42.5(pid=13271): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13271)] 13:53:26.295378 run osmo-stp_10.42.42.5(pid=13271): stdout: | (launched: 2022-12-09_13:53:24.901201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:26.423355 run osmo-stp_10.42.42.5(pid=13271): stderr: | 20221209135325095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135325095 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135325095 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135325096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135325096 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135325096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135325096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:26.549828 run osmo-stp_10.42.42.5(pid=13271): stdout: | (launched: 2022-12-09_13:53:24.901201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:26.670564 run osmo-stp_10.42.42.5(pid=13271): stderr: | 20221209135325095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135325095 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135325095 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135325096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135325096 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135325096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135325096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:26.814979 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13271): Process ended prematurely: osmo-stp_10.42.42.5(pid=13271) [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13271)] [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:53:26.824063 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 13:53:26.850850 run osmo-hlr_10.42.42.2(pid=13268): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13268)] 13:53:26.898369 run osmo-hlr_10.42.42.2(pid=13268): stdout: | (launched: 2022-12-09_13:53:23.595709) 13:53:26.947528 run osmo-hlr_10.42.42.2(pid=13268): stderr: | 20221209135323938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135323938 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135323938 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135323938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135323938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135323938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135323955 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135323968 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135323968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135323968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:27.016794 run osmo-msc_10.42.42.6(pid=13274): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13274)] 13:53:27.064109 run osmo-msc_10.42.42.6(pid=13274): stdout: | (launched: 2022-12-09_13:53:25.933457) 13:53:27.112838 run osmo-msc_10.42.42.6(pid=13274): stderr: | 20221209135326207 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209135326207 DLGLOBAL DEBUG validating counter group 0x7fd64cc5fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209135326207 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209135326207 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209135326207 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209135326207 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209135326209 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209135326210 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209135326210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209135326210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:53:27.162004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13267): Terminating (SIGTERM) 13:53:27.201772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13270): Terminating (SIGTERM) 13:53:27.241608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13273): Terminating (SIGTERM) 13:53:27.282079 --- ParallelTerminationStrategy: PID 13267 died... 13:53:27.301046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13267): Terminated: ok {rc=0} 13:53:27.345528 --- ParallelTerminationStrategy: PID 13270 died... 13:53:27.364038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13270): Terminated: ok {rc=0} 13:53:27.407816 --- ParallelTerminationStrategy: PID 13273 died... 13:53:27.426407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13273): Terminated: ok {rc=0} 13:53:27.510240 bus /sierra_3: Setting Powered False 13:53:28.607143 bus /sierra_3: Setting Powered False 13:53:29.724886 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:53:31.001938 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:53:31.009321 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:53:31.042929 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:53:31.070066 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:53:31.123923 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:53:31.175630 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:53:31.204336 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:53:31.753630 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:53:31.807875 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:53:31.820181 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:53:31.888741 tst mo_mt_call.py: using LAC 21911 13:53:32.062602 tst mo_mt_call.py: using RAC 236 13:53:32.181374 tst mo_mt_call.py: using CellId 21911 13:53:32.305421 tst mo_mt_call.py: using BVCI 21912 13:53:32.423633 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:53:32.435495 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:53:32.447366 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:53:32.459466 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:53:32.471564 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:53:32.483625 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:53:32.601971 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:53:32.720566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:33.221749 run create_hlr_db(pid=13279): Launched 13:53:33.345385 bus /sierra_2: Setting Powered False 13:53:34.409497 run create_hlr_db(pid=13279): Terminated: ok {rc=0} 13:53:34.857050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13281): Launched 13:53:35.179402 run osmo-hlr_10.42.42.2(pid=13282): Launched 13:53:35.301910 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:35.859448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13284): Launched 13:53:36.183282 run osmo-stp_10.42.42.5(pid=13285): Launched 13:53:36.306750 run osmo-msc_10.42.42.6: Starting osmo-msc 13:53:36.890843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13287): Launched 13:53:37.214111 run osmo-msc_10.42.42.6(pid=13288): Launched 13:53:37.394228 run osmo-stp_10.42.42.5(pid=13285): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13285)] 13:53:37.531735 run osmo-stp_10.42.42.5(pid=13285): stdout: | (launched: 2022-12-09_13:53:36.124262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:37.668531 run osmo-stp_10.42.42.5(pid=13285): stderr: | 20221209135336314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135336314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135336314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135336315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135336315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135336315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135336315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:37.804495 run osmo-stp_10.42.42.5(pid=13285): stdout: | (launched: 2022-12-09_13:53:36.124262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:37.933288 run osmo-stp_10.42.42.5(pid=13285): stderr: | 20221209135336314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135336314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135336314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135336315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135336315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135336315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135336315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:38.088122 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13285): Process ended prematurely: osmo-stp_10.42.42.5(pid=13285) [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13285)] [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:53:38.097892 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:53:38.126425 run osmo-hlr_10.42.42.2(pid=13282): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13282)] 13:53:38.177052 run osmo-hlr_10.42.42.2(pid=13282): stdout: | (launched: 2022-12-09_13:53:35.120587) 13:53:38.229070 run osmo-hlr_10.42.42.2(pid=13282): stderr: | 20221209135335319 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135335319 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135335320 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135335320 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135335320 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135335320 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135335340 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135335351 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135335352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135335352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:38.301500 run osmo-msc_10.42.42.6(pid=13288): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13288)] 13:53:38.351990 run osmo-msc_10.42.42.6(pid=13288): stdout: | (launched: 2022-12-09_13:53:37.154961) 13:53:38.404091 run osmo-msc_10.42.42.6(pid=13288): stderr: | 20221209135337474 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209135337474 DLGLOBAL DEBUG validating counter group 0x7fb47013bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209135337474 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209135337474 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209135337474 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209135337475 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209135337476 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209135337477 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209135337477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209135337477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:53:38.456668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13281): Terminating (SIGTERM) 13:53:38.499012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13284): Terminating (SIGTERM) 13:53:38.541345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13287): Terminating (SIGTERM) 13:53:38.583950 --- ParallelTerminationStrategy: PID 13281 died... 13:53:38.604154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13281): Terminated: ok {rc=0} 13:53:38.651179 --- ParallelTerminationStrategy: PID 13284 died... 13:53:38.670957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13284): Terminated: ok {rc=0} 13:53:38.717763 --- ParallelTerminationStrategy: PID 13287 died... 13:53:38.737459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13287): Terminated: ok {rc=0} 13:53:38.825193 bus /sierra_3: Setting Powered False 13:53:39.924264 bus /sierra_3: Setting Powered False 13:53:41.039541 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:53:42.186598 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:53:42.198722 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:53:42.265379 tst mo_mt_call_osmux.py: using LAC 21912 13:53:42.384652 tst mo_mt_call_osmux.py: using RAC 237 13:53:42.504871 tst mo_mt_call_osmux.py: using CellId 21912 13:53:42.623386 tst mo_mt_call_osmux.py: using BVCI 21913 13:53:42.732851 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:53:42.744226 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:53:42.755404 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:53:42.766325 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:53:42.777568 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:53:42.788480 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:53:42.902356 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:53:43.022793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:43.523757 run create_hlr_db(pid=13291): Launched 13:53:43.648052 bus /sierra_2: Setting Powered False 13:53:44.712460 run create_hlr_db(pid=13291): Terminated: ok {rc=0} 13:53:45.144017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13293): Launched 13:53:45.446124 run osmo-hlr_10.42.42.2(pid=13294): Launched 13:53:45.561411 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:46.117937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13296): Launched 13:53:46.442742 run osmo-stp_10.42.42.5(pid=13297): Launched 13:53:46.631404 run osmo-msc_10.42.42.6: Starting osmo-msc 13:53:47.298127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13299): Launched 13:53:47.622942 run osmo-msc_10.42.42.6(pid=13300): Launched 13:53:47.803821 run osmo-stp_10.42.42.5(pid=13297): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13297)] 13:53:47.940418 run osmo-stp_10.42.42.5(pid=13297): stdout: | (launched: 2022-12-09_13:53:46.383044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:48.079415 run osmo-stp_10.42.42.5(pid=13297): stderr: | 20221209135346751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135346751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135346752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135346752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135346753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135346753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135346753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:48.215335 run osmo-stp_10.42.42.5(pid=13297): stdout: | (launched: 2022-12-09_13:53:46.383044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:48.344272 run osmo-stp_10.42.42.5(pid=13297): stderr: | 20221209135346751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135346751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135346752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135346752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135346753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135346753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135346753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:48.497985 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13297): Process ended prematurely: osmo-stp_10.42.42.5(pid=13297) [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13297)] [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:53:48.507594 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:53:48.536183 run osmo-hlr_10.42.42.2(pid=13294): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13294)] 13:53:48.586872 run osmo-hlr_10.42.42.2(pid=13294): stdout: | (launched: 2022-12-09_13:53:45.390457) 13:53:48.638904 run osmo-hlr_10.42.42.2(pid=13294): stderr: | 20221209135345566 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135345566 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135345566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135345566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135345566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135345566 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135345577 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135345586 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135345587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135345587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:48.711688 run osmo-msc_10.42.42.6(pid=13300): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13300)] 13:53:48.761930 run osmo-msc_10.42.42.6(pid=13300): stdout: | (launched: 2022-12-09_13:53:47.563454) 13:53:48.813873 run osmo-msc_10.42.42.6(pid=13300): stderr: | 20221209135347883 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209135347883 DLGLOBAL DEBUG validating counter group 0x7fa2a5611c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209135347883 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209135347884 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209135347884 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209135347884 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209135347886 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209135347886 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209135347886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209135347886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:53:48.866231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13293): Terminating (SIGTERM) 13:53:48.908320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13296): Terminating (SIGTERM) 13:53:48.950287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13299): Terminating (SIGTERM) 13:53:48.992497 --- ParallelTerminationStrategy: PID 13293 died... 13:53:49.013182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13293): Terminated: ok {rc=0} 13:53:49.060076 --- ParallelTerminationStrategy: PID 13296 died... 13:53:49.079708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13296): Terminated: ok {rc=0} 13:53:49.126466 --- ParallelTerminationStrategy: PID 13299 died... 13:53:49.146185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13299): Terminated: ok {rc=0} 13:53:49.234235 bus /sierra_3: Setting Powered False 13:53:50.330631 bus /sierra_3: Setting Powered False 13:53:51.445536 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:53:52.701135 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:53:52.709662 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:53:52.743451 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:53:52.771991 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:53:52.826289 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:53:52.860295 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:53:52.887846 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:53:53.439075 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:53:53.490770 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:53:53.502533 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:53:53.573579 tst mo_mt_call.py: using LAC 21913 13:53:53.698854 tst mo_mt_call.py: using RAC 238 13:53:53.816678 tst mo_mt_call.py: using CellId 21913 13:53:53.935123 tst mo_mt_call.py: using BVCI 21914 13:53:54.046660 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:53:54.058318 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:53:54.069655 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:53:54.080843 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:53:54.092262 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:53:54.103529 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:53:54.223613 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:53:54.338345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:54.806593 run create_hlr_db(pid=13305): Launched 13:53:54.929310 bus /sierra_2: Setting Powered False 13:53:55.989199 run create_hlr_db(pid=13305): Terminated: ok {rc=0} 13:53:56.431000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13307): Launched 13:53:56.753379 run osmo-hlr_10.42.42.2(pid=13308): Launched 13:53:56.876209 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:57.433631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13310): Launched 13:53:57.754675 run osmo-stp_10.42.42.5(pid=13311): Launched 13:53:57.877116 run osmo-msc_10.42.42.6: Starting osmo-msc 13:53:58.458201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13313): Launched 13:53:58.779456 run osmo-msc_10.42.42.6(pid=13314): Launched 13:53:58.959349 run osmo-stp_10.42.42.5(pid=13311): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13311)] 13:53:59.096332 run osmo-stp_10.42.42.5(pid=13311): stdout: | (launched: 2022-12-09_13:53:57.696052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:59.232667 run osmo-stp_10.42.42.5(pid=13311): stderr: | 20221209135357886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135357886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135357887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135357887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135357887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135357888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135357888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:59.368062 run osmo-stp_10.42.42.5(pid=13311): stdout: | (launched: 2022-12-09_13:53:57.696052) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:59.496188 run osmo-stp_10.42.42.5(pid=13311): stderr: | 20221209135357886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135357886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135357887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135357887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135357887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135357888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135357888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:59.649500 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13311): Process ended prematurely: osmo-stp_10.42.42.5(pid=13311) [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13311)] [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:53:59.658942 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:53:59.687338 run osmo-hlr_10.42.42.2(pid=13308): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13308)] 13:53:59.737808 run osmo-hlr_10.42.42.2(pid=13308): stdout: | (launched: 2022-12-09_13:53:56.694582) 13:53:59.789964 run osmo-hlr_10.42.42.2(pid=13308): stderr: | 20221209135356892 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135356892 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135356892 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135356892 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135356892 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135356892 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135356904 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135356913 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135356913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135356913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:59.862762 run osmo-msc_10.42.42.6(pid=13314): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13314)] 13:53:59.913300 run osmo-msc_10.42.42.6(pid=13314): stdout: | (launched: 2022-12-09_13:53:58.720374) 13:53:59.965396 run osmo-msc_10.42.42.6(pid=13314): stderr: | 20221209135359040 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209135359040 DLGLOBAL DEBUG validating counter group 0x7fb6a9a5dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209135359040 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209135359040 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209135359040 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209135359041 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209135359042 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209135359043 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209135359043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209135359043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:54:00.018336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13307): Terminating (SIGTERM) 13:54:00.060310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13310): Terminating (SIGTERM) 13:54:00.102295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13313): Terminating (SIGTERM) 13:54:00.144501 --- ParallelTerminationStrategy: PID 13307 died... 13:54:00.164550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13307): Terminated: ok {rc=0} 13:54:00.211173 --- ParallelTerminationStrategy: PID 13310 died... 13:54:00.230805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13310): Terminated: ok {rc=0} 13:54:00.277466 --- ParallelTerminationStrategy: PID 13313 died... 13:54:00.296766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13313): Terminated: ok {rc=0} 13:54:00.385513 bus /sierra_3: Setting Powered False 13:54:01.485650 bus /sierra_3: Setting Powered False 13:54:02.608875 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:54:03.758335 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:54:03.771783 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:54:03.841310 tst mo_mt_call_osmux.py: using LAC 21914 13:54:03.969380 tst mo_mt_call_osmux.py: using RAC 239 13:54:04.095961 tst mo_mt_call_osmux.py: using CellId 21914 13:54:04.227858 tst mo_mt_call_osmux.py: using BVCI 21915 13:54:04.346683 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:54:04.358448 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:54:04.369915 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:54:04.381789 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:54:04.393709 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:54:04.406162 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:54:04.524811 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:54:04.645812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:05.115555 run create_hlr_db(pid=13316): Launched 13:54:05.240438 bus /sierra_2: Setting Powered False 13:54:06.301723 run create_hlr_db(pid=13316): Terminated: ok {rc=0} 13:54:06.742665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13318): Launched 13:54:07.051475 run osmo-hlr_10.42.42.2(pid=13319): Launched 13:54:07.167496 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:07.687987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13321): Launched 13:54:07.989935 run osmo-stp_10.42.42.5(pid=13322): Launched 13:54:08.104352 run osmo-msc_10.42.42.6: Starting osmo-msc 13:54:08.650991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13324): Launched 13:54:08.953682 run osmo-msc_10.42.42.6(pid=13325): Launched 13:54:09.124081 run osmo-stp_10.42.42.5(pid=13322): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13322)] 13:54:09.252118 run osmo-stp_10.42.42.5(pid=13322): stdout: | (launched: 2022-12-09_13:54:07.933993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:09.380343 run osmo-stp_10.42.42.5(pid=13322): stderr: | 20221209135408106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135408106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135408107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135408107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135408107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135408108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135408108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:09.506333 run osmo-stp_10.42.42.5(pid=13322): stdout: | (launched: 2022-12-09_13:54:07.933993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:09.626710 run osmo-stp_10.42.42.5(pid=13322): stderr: | 20221209135408106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135408106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135408107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135408107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135408107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135408108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135408108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:09.770700 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13322): Process ended prematurely: osmo-stp_10.42.42.5(pid=13322) [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13322)] [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:54:09.779606 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:54:09.806082 run osmo-hlr_10.42.42.2(pid=13319): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13319)] 13:54:09.853690 run osmo-hlr_10.42.42.2(pid=13319): stdout: | (launched: 2022-12-09_13:54:06.995980) 13:54:09.903079 run osmo-hlr_10.42.42.2(pid=13319): stderr: | 20221209135407170 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135407170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135407170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135407170 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135407170 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135407170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135407183 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135407191 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135407192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135407192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:09.972153 run osmo-msc_10.42.42.6(pid=13325): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13325)] 13:54:10.019497 run osmo-msc_10.42.42.6(pid=13325): stdout: | (launched: 2022-12-09_13:54:08.897387) 13:54:10.068509 run osmo-msc_10.42.42.6(pid=13325): stderr: | 20221209135409169 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209135409170 DLGLOBAL DEBUG validating counter group 0x7f9acf8d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209135409170 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209135409170 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209135409170 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209135409170 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209135409172 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209135409172 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209135409172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209135409173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:54:10.117858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13318): Terminating (SIGTERM) 13:54:10.157516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13321): Terminating (SIGTERM) 13:54:10.197020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13324): Terminating (SIGTERM) 13:54:10.236579 --- ParallelTerminationStrategy: PID 13318 died... 13:54:10.255659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13318): Terminated: ok {rc=0} 13:54:10.299758 --- ParallelTerminationStrategy: PID 13321 died... 13:54:10.318516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13321): Terminated: ok {rc=0} 13:54:10.362000 --- ParallelTerminationStrategy: PID 13324 died... 13:54:10.380818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13324): Terminated: ok {rc=0} 13:54:10.466838 bus /sierra_3: Setting Powered False 13:54:11.567302 bus /sierra_3: Setting Powered False 13:54:12.682924 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:54:13.934859 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:54:13.943347 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:54:13.977455 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:54:14.005120 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:54:14.058879 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:54:14.092425 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:54:14.119949 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:54:14.672001 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:54:14.723646 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:54:14.735335 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:54:14.803757 tst mo_mt_call.py: using LAC 21915 13:54:14.929665 tst mo_mt_call.py: using RAC 240 13:54:15.055869 tst mo_mt_call.py: using CellId 21915 13:54:15.183446 tst mo_mt_call.py: using BVCI 21916 13:54:15.299991 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:54:15.311771 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:54:15.323463 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:54:15.335163 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:54:15.346859 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:54:15.358636 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:54:15.476056 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:54:15.596527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:16.135385 run create_hlr_db(pid=13331): Launched 13:54:16.313332 bus /sierra_2: Setting Powered False 13:54:17.375787 run create_hlr_db(pid=13331): Terminated: ok {rc=0} 13:54:17.823683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13333): Launched 13:54:18.126207 run osmo-hlr_10.42.42.2(pid=13334): Launched 13:54:18.240346 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:18.772934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13336): Launched 13:54:19.075045 run osmo-stp_10.42.42.5(pid=13337): Launched 13:54:19.189098 run osmo-msc_10.42.42.6: Starting osmo-msc 13:54:19.732733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13339): Launched 13:54:20.032810 run osmo-msc_10.42.42.6(pid=13340): Launched 13:54:20.201108 run osmo-stp_10.42.42.5(pid=13337): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13337)] 13:54:20.327958 run osmo-stp_10.42.42.5(pid=13337): stdout: | (launched: 2022-12-09_13:54:19.019047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:20.455963 run osmo-stp_10.42.42.5(pid=13337): stderr: | 20221209135419188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135419188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135419188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135419189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135419189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135419189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135419189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:20.581398 run osmo-stp_10.42.42.5(pid=13337): stdout: | (launched: 2022-12-09_13:54:19.019047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:20.701200 run osmo-stp_10.42.42.5(pid=13337): stderr: | 20221209135419188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135419188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135419188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135419189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135419189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135419189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135419189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:20.844230 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13337): Process ended prematurely: osmo-stp_10.42.42.5(pid=13337) [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13337)] [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:54:20.853318 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:54:20.879890 run osmo-hlr_10.42.42.2(pid=13334): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13334)] 13:54:20.927528 run osmo-hlr_10.42.42.2(pid=13334): stdout: | (launched: 2022-12-09_13:54:18.070582) 13:54:20.976759 run osmo-hlr_10.42.42.2(pid=13334): stderr: | 20221209135418246 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135418246 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135418246 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135418246 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135418246 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135418246 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135418258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135418267 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135418267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135418267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:21.045909 run osmo-msc_10.42.42.6(pid=13340): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13340)] 13:54:21.093487 run osmo-msc_10.42.42.6(pid=13340): stdout: | (launched: 2022-12-09_13:54:19.977405) 13:54:21.142454 run osmo-msc_10.42.42.6(pid=13340): stderr: | 20221209135420250 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209135420250 DLGLOBAL DEBUG validating counter group 0x7fdf77c5bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209135420251 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209135420251 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209135420251 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209135420252 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209135420254 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209135420254 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209135420254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209135420255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:54:21.191757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13333): Terminating (SIGTERM) 13:54:21.231375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13336): Terminating (SIGTERM) 13:54:21.270774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13339): Terminating (SIGTERM) 13:54:21.310582 --- ParallelTerminationStrategy: PID 13333 died... 13:54:21.329670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13333): Terminated: ok {rc=0} 13:54:21.375049 --- ParallelTerminationStrategy: PID 13336 died... 13:54:21.393794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13336): Terminated: ok {rc=0} 13:54:21.437305 --- ParallelTerminationStrategy: PID 13339 died... 13:54:21.455944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13339): Terminated: ok {rc=0} 13:54:21.538683 bus /sierra_3: Setting Powered False 13:54:22.636535 bus /sierra_3: Setting Powered False 13:54:23.753593 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:54:24.903625 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:54:24.915916 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:54:24.985418 tst mo_mt_call_osmux.py: using LAC 21916 13:54:25.113274 tst mo_mt_call_osmux.py: using RAC 241 13:54:25.243411 tst mo_mt_call_osmux.py: using CellId 21916 13:54:25.369752 tst mo_mt_call_osmux.py: using BVCI 21917 13:54:25.480722 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:54:25.492003 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:54:25.503026 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:54:25.516397 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:54:25.528893 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:54:25.540396 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:54:25.659411 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:54:25.777623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:26.247606 run create_hlr_db(pid=13342): Launched 13:54:26.370184 bus /sierra_2: Setting Powered False 13:54:27.430926 run create_hlr_db(pid=13342): Terminated: ok {rc=0} 13:54:27.871181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13344): Launched 13:54:28.178823 run osmo-hlr_10.42.42.2(pid=13345): Launched 13:54:28.292724 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:28.810099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13347): Launched 13:54:29.111822 run osmo-stp_10.42.42.5(pid=13348): Launched 13:54:29.226552 run osmo-msc_10.42.42.6: Starting osmo-msc 13:54:29.771130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13350): Launched 13:54:30.072337 run osmo-msc_10.42.42.6(pid=13351): Launched 13:54:30.240535 run osmo-stp_10.42.42.5(pid=13348): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13348)] 13:54:30.368093 run osmo-stp_10.42.42.5(pid=13348): stdout: | (launched: 2022-12-09_13:54:29.055836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:30.496131 run osmo-stp_10.42.42.5(pid=13348): stderr: | 20221209135429227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135429227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135429227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135429227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135429228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135429228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135429228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:30.621522 run osmo-stp_10.42.42.5(pid=13348): stdout: | (launched: 2022-12-09_13:54:29.055836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:30.741375 run osmo-stp_10.42.42.5(pid=13348): stderr: | 20221209135429227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135429227 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135429227 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135429227 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135429228 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135429228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135429228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:30.923965 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13348): Process ended prematurely: osmo-stp_10.42.42.5(pid=13348) [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13348)] [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:54:30.934663 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:54:30.966166 run osmo-hlr_10.42.42.2(pid=13345): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13345)] 13:54:31.022445 run osmo-hlr_10.42.42.2(pid=13345): stdout: | (launched: 2022-12-09_13:54:28.122781) 13:54:31.079984 run osmo-hlr_10.42.42.2(pid=13345): stderr: | 20221209135428298 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135428298 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135428298 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135428298 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135428298 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135428298 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135428314 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135428325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135428325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135428325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:31.157419 run osmo-msc_10.42.42.6(pid=13351): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13351)] 13:54:31.211051 run osmo-msc_10.42.42.6(pid=13351): stdout: | (launched: 2022-12-09_13:54:30.016765) 13:54:31.265275 run osmo-msc_10.42.42.6(pid=13351): stderr: | 20221209135430287 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209135430287 DLGLOBAL DEBUG validating counter group 0x7fd8843ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209135430287 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209135430287 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209135430287 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209135430288 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209135430289 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209135430290 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209135430290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209135430290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:54:31.320516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13344): Terminating (SIGTERM) 13:54:31.366214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13347): Terminating (SIGTERM) 13:54:31.413364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13350): Terminating (SIGTERM) 13:54:31.460122 --- ParallelTerminationStrategy: PID 13344 died... 13:54:31.481053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13344): Terminated: ok {rc=0} 13:54:31.533093 --- ParallelTerminationStrategy: PID 13347 died... 13:54:31.554088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13347): Terminated: ok {rc=0} 13:54:31.606628 --- ParallelTerminationStrategy: PID 13350 died... 13:54:31.627406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13350): Terminated: ok {rc=0} 13:54:31.720133 bus /sierra_3: Setting Powered False 13:54:32.820998 bus /sierra_3: Setting Powered False 13:54:33.937486 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:54:35.188248 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:54:35.197108 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:54:35.231054 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:54:35.258687 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:54:35.312248 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:54:35.346455 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:54:35.374043 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:54:35.926843 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:54:35.978527 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:54:35.990309 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:54:36.058666 tst mo_mt_call.py: using LAC 21917 13:54:36.186114 tst mo_mt_call.py: using RAC 242 13:54:36.311479 tst mo_mt_call.py: using CellId 21917 13:54:36.438260 tst mo_mt_call.py: using BVCI 21918 13:54:36.556847 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:54:36.568800 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:54:36.580315 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:54:36.592114 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:54:36.603940 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:54:36.615613 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:54:36.733899 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:54:36.853741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:37.322237 run create_hlr_db(pid=13356): Launched 13:54:37.446177 bus /sierra_2: Setting Powered False 13:54:38.507025 run create_hlr_db(pid=13356): Terminated: ok {rc=0} 13:54:38.927345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13358): Launched 13:54:39.229215 run osmo-hlr_10.42.42.2(pid=13359): Launched 13:54:39.344003 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:39.861405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13361): Launched 13:54:40.163689 run osmo-stp_10.42.42.5(pid=13362): Launched 13:54:40.278402 run osmo-msc_10.42.42.6: Starting osmo-msc 13:54:40.824918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13364): Launched 13:54:41.125980 run osmo-msc_10.42.42.6(pid=13365): Launched 13:54:41.293696 run osmo-stp_10.42.42.5(pid=13362): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13362)] 13:54:41.420779 run osmo-stp_10.42.42.5(pid=13362): stdout: | (launched: 2022-12-09_13:54:40.107400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:41.547550 run osmo-stp_10.42.42.5(pid=13362): stderr: | 20221209135440277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135440277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135440277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135440277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135440278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135440278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135440278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:41.672622 run osmo-stp_10.42.42.5(pid=13362): stdout: | (launched: 2022-12-09_13:54:40.107400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:41.792050 run osmo-stp_10.42.42.5(pid=13362): stderr: | 20221209135440277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135440277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135440277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135440277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135440278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135440278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135440278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:41.935701 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13362): Process ended prematurely: osmo-stp_10.42.42.5(pid=13362) [trial-2360↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13362)] [trial-2360↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:54:41.944584 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:54:41.971020 run osmo-hlr_10.42.42.2(pid=13359): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13359)] 13:54:42.018657 run osmo-hlr_10.42.42.2(pid=13359): stdout: | (launched: 2022-12-09_13:54:39.173302) 13:54:42.068039 run osmo-hlr_10.42.42.2(pid=13359): stderr: | 20221209135439348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135439348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135439348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135439348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135439348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135439348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135439360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135439371 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135439371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135439371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:42.137373 run osmo-msc_10.42.42.6(pid=13365): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13365)] 13:54:42.185117 run osmo-msc_10.42.42.6(pid=13365): stdout: | (launched: 2022-12-09_13:54:41.070354) 13:54:42.234132 run osmo-msc_10.42.42.6(pid=13365): stderr: | 20221209135441340 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209135441340 DLGLOBAL DEBUG validating counter group 0x7f1ead5fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209135441340 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209135441340 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209135441341 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209135441341 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209135441343 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209135441343 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209135441343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209135441343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:54:42.283487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13358): Terminating (SIGTERM) 13:54:42.323164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13361): Terminating (SIGTERM) 13:54:42.362753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13364): Terminating (SIGTERM) 13:54:42.402423 --- ParallelTerminationStrategy: PID 13358 died... 13:54:42.421447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13358): Terminated: ok {rc=0} 13:54:42.464864 --- ParallelTerminationStrategy: PID 13361 died... 13:54:42.483476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13361): Terminated: ok {rc=0} 13:54:42.527079 --- ParallelTerminationStrategy: PID 13364 died... 13:54:42.546059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13364): Terminated: ok {rc=0} 13:54:42.631795 bus /sierra_3: Setting Powered False 13:54:43.731512 bus /sierra_3: Setting Powered False 13:54:44.847365 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:54:46.011580 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:54:46.025189 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:54:46.098291 tst mo_mt_call_osmux.py: using LAC 21918 13:54:46.219179 tst mo_mt_call_osmux.py: using RAC 243 13:54:46.338128 tst mo_mt_call_osmux.py: using CellId 21918 13:54:46.467222 tst mo_mt_call_osmux.py: using BVCI 21919 13:54:46.610679 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:54:46.623631 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:54:46.636237 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:54:46.650590 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:54:46.664771 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:54:46.677456 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:54:46.804174 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:54:46.946530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:47.421387 run create_hlr_db(pid=13367): Launched 13:54:47.543893 bus /sierra_2: Setting Powered False 13:54:48.604281 run create_hlr_db(pid=13367): Terminated: ok {rc=0} 13:54:49.023687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13369): Launched 13:54:49.323899 run osmo-hlr_10.42.42.2(pid=13370): Launched 13:54:49.437583 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:49.968440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13372): Launched 13:54:50.269407 run osmo-stp_10.42.42.5(pid=13373): Launched 13:54:50.383308 run osmo-msc_10.42.42.6: Starting osmo-msc 13:54:50.928154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13375): Launched 13:54:51.229874 run osmo-msc_10.42.42.6(pid=13376): Launched 13:54:51.398537 run osmo-stp_10.42.42.5(pid=13373): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13373)] 13:54:51.526184 run osmo-stp_10.42.42.5(pid=13373): stdout: | (launched: 2022-12-09_13:54:50.213615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:51.653400 run osmo-stp_10.42.42.5(pid=13373): stderr: | 20221209135450385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135450386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135450386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135450386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135450387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135450387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135450387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:51.778784 run osmo-stp_10.42.42.5(pid=13373): stdout: | (launched: 2022-12-09_13:54:50.213615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:51.898772 run osmo-stp_10.42.42.5(pid=13373): stderr: | 20221209135450385 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135450386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135450386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135450386 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135450387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135450387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135450387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:52.042454 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13373): Process ended prematurely: osmo-stp_10.42.42.5(pid=13373) [trial-2360↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13373)] [trial-2360↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:54:52.051254 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:54:52.078264 run osmo-hlr_10.42.42.2(pid=13370): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13370)] 13:54:52.125923 run osmo-hlr_10.42.42.2(pid=13370): stdout: | (launched: 2022-12-09_13:54:49.268412) 13:54:52.175209 run osmo-hlr_10.42.42.2(pid=13370): stderr: | 20221209135449444 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135449444 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135449444 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135449444 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135449444 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135449444 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135449456 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135449465 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135449465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135449465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:52.244696 run osmo-msc_10.42.42.6(pid=13376): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13376)] 13:54:52.291934 run osmo-msc_10.42.42.6(pid=13376): stdout: | (launched: 2022-12-09_13:54:51.174183) 13:54:52.341207 run osmo-msc_10.42.42.6(pid=13376): stderr: | 20221209135451446 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209135451446 DLGLOBAL DEBUG validating counter group 0x7f39656c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209135451446 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209135451446 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209135451447 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209135451447 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209135451448 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209135451449 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209135451449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209135451449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:54:52.390639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13369): Terminating (SIGTERM) 13:54:52.430206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13372): Terminating (SIGTERM) 13:54:52.469971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13375): Terminating (SIGTERM) 13:54:52.509915 --- ParallelTerminationStrategy: PID 13369 died... 13:54:52.529127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13369): Terminated: ok {rc=0} 13:54:52.572700 --- ParallelTerminationStrategy: PID 13372 died... 13:54:52.591349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13372): Terminated: ok {rc=0} 13:54:52.635274 --- ParallelTerminationStrategy: PID 13375 died... 13:54:52.654113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13375): Terminated: ok {rc=0} 13:54:52.736718 bus /sierra_3: Setting Powered False 13:54:53.834713 bus /sierra_3: Setting Powered False 13:54:54.951021 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:54:56.196346 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:54:56.203061 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:54:56.234820 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 13:54:56.261172 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 13:54:56.311802 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:54:56.343729 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 13:54:56.370323 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 13:54:56.923859 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 13:54:56.980479 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:54:56.992491 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:54:57.044560 tst mo_mt_call.py: using LAC 21919 13:54:57.173182 tst mo_mt_call.py: using RAC 244 13:54:57.298988 tst mo_mt_call.py: using CellId 21919 13:54:57.425145 tst mo_mt_call.py: using BVCI 21920 13:54:57.542656 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:54:57.554630 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:54:57.566488 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:54:57.578403 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:54:57.591246 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:54:57.603654 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:54:57.719565 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:54:57.837773 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:58.336602 run create_hlr_db(pid=13382): Launched 13:54:58.459265 bus /sierra_2: Setting Powered False 13:54:59.523112 run create_hlr_db(pid=13382): Terminated: ok {rc=0} 13:54:59.971060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13384): Launched 13:55:00.293873 run osmo-hlr_10.42.42.2(pid=13385): Launched 13:55:00.417137 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:00.989401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13387): Launched 13:55:01.321838 run osmo-stp_10.42.42.5(pid=13388): Launched 13:55:01.444323 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:02.347769 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13393): Launched 13:55:02.675832 run osmo-msc_10.42.42.6(pid=13394): Launched 13:55:02.855437 run osmo-stp_10.42.42.5(pid=13388): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13388)] 13:55:02.991837 run osmo-stp_10.42.42.5(pid=13388): stdout: | (launched: 2022-12-09_13:55:01.261350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:03.129242 run osmo-stp_10.42.42.5(pid=13388): stderr: | 20221209135501679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135501679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135501681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135501683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135501684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135501684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135501684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:03.264601 run osmo-stp_10.42.42.5(pid=13388): stdout: | (launched: 2022-12-09_13:55:01.261350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:03.392719 run osmo-stp_10.42.42.5(pid=13388): stderr: | 20221209135501679 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135501679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135501681 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135501683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135501684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135501684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135501684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:03.546122 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13388): Process ended prematurely: osmo-stp_10.42.42.5(pid=13388) [trial-2360↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13388)] [trial-2360↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 13:55:03.555578 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 13:55:03.584244 run osmo-hlr_10.42.42.2(pid=13385): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13385)] 13:55:03.634590 run osmo-hlr_10.42.42.2(pid=13385): stdout: | (launched: 2022-12-09_13:55:00.234884) 13:55:03.686649 run osmo-hlr_10.42.42.2(pid=13385): stderr: | 20221209135500432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135500433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135500433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135500433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135500433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135500433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135500445 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135500453 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135500453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135500453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:03.759049 run osmo-msc_10.42.42.6(pid=13394): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13394)] 13:55:03.809164 run osmo-msc_10.42.42.6(pid=13394): stdout: | (launched: 2022-12-09_13:55:02.616620) 13:55:03.861180 run osmo-msc_10.42.42.6(pid=13394): stderr: | 20221209135502938 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209135502938 DLGLOBAL DEBUG validating counter group 0x7fa470676c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209135502938 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209135502938 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209135502938 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209135502939 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209135502940 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209135502941 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209135502941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209135502941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:03.913637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13384): Terminating (SIGTERM) 13:55:03.955390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13387): Terminating (SIGTERM) 13:55:03.997739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13393): Terminating (SIGTERM) 13:55:04.040252 --- ParallelTerminationStrategy: PID 13384 died... 13:55:04.060013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13384): Terminated: ok {rc=0} 13:55:04.106950 --- ParallelTerminationStrategy: PID 13387 died... 13:55:04.126644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13387): Terminated: ok {rc=0} 13:55:04.172892 --- ParallelTerminationStrategy: PID 13393 died... 13:55:04.192372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13393): Terminated: ok {rc=0} 13:55:04.280318 bus /sierra_3: Setting Powered False 13:55:05.376715 bus /sierra_3: Setting Powered False 13:55:06.491797 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 13:55:07.642502 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:55:07.655157 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:55:07.707174 tst mo_mt_call_osmux.py: using LAC 21920 13:55:07.838331 tst mo_mt_call_osmux.py: using RAC 245 13:55:07.963855 tst mo_mt_call_osmux.py: using CellId 21920 13:55:08.090047 tst mo_mt_call_osmux.py: using BVCI 21921 13:55:08.209412 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:55:08.221367 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:55:08.233034 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:55:08.244907 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:55:08.256886 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:55:08.269143 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:55:08.387091 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:55:08.508095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:09.009476 run create_hlr_db(pid=13396): Launched 13:55:09.132297 bus /sierra_2: Setting Powered False 13:55:10.196444 run create_hlr_db(pid=13396): Terminated: ok {rc=0} 13:55:10.628119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13398): Launched 13:55:10.930727 run osmo-hlr_10.42.42.2(pid=13399): Launched 13:55:11.044860 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:11.567071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13401): Launched 13:55:11.869152 run osmo-stp_10.42.42.5(pid=13402): Launched 13:55:11.982805 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:12.526847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13404): Launched 13:55:12.828531 run osmo-msc_10.42.42.6(pid=13405): Launched 13:55:12.997867 run osmo-stp_10.42.42.5(pid=13402): ERR: Terminated: ERROR {rc=1} [trial-2360↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13402)] 13:55:13.125871 run osmo-stp_10.42.42.5(pid=13402): stdout: | (launched: 2022-12-09_13:55:11.813267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:13.253261 run osmo-stp_10.42.42.5(pid=13402): stderr: | 20221209135511984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135511984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135511984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135511985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135511985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135511985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135511986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:13.378470 run osmo-stp_10.42.42.5(pid=13402): stdout: | (launched: 2022-12-09_13:55:11.813267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:13.498376 run osmo-stp_10.42.42.5(pid=13402): stderr: | 20221209135511984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135511984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135511984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135511985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135511985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135511985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135511986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:13.642200 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13402): Process ended prematurely: osmo-stp_10.42.42.5(pid=13402) [trial-2360↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13402)] [trial-2360↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 13:55:13.651118 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:55:13.677560 run osmo-hlr_10.42.42.2(pid=13399): ERR: Terminated: ERROR {rc=237} [trial-2360↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13399)] 13:55:13.725230 run osmo-hlr_10.42.42.2(pid=13399): stdout: | (launched: 2022-12-09_13:55:10.875277) 13:55:13.774542 run osmo-hlr_10.42.42.2(pid=13399): stderr: | 20221209135511053 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135511053 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135511053 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135511053 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135511053 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135511053 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135511065 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135511074 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135511074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135511074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:13.850158 run osmo-msc_10.42.42.6(pid=13405): ERR: Terminated: ERROR {rc=2} [trial-2360↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13405)] 13:55:13.900401 run osmo-msc_10.42.42.6(pid=13405): stdout: | (launched: 2022-12-09_13:55:12.772322) 13:55:13.951917 run osmo-msc_10.42.42.6(pid=13405): stderr: | 20221209135513043 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209135513043 DLGLOBAL DEBUG validating counter group 0x7f28f5134c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209135513043 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209135513043 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209135513043 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209135513043 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209135513045 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209135513046 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209135513046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209135513046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:14.004280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13398): Terminating (SIGTERM) 13:55:14.046637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13401): Terminating (SIGTERM) 13:55:14.088856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13404): Terminating (SIGTERM) 13:55:14.131274 --- ParallelTerminationStrategy: PID 13398 died... 13:55:14.151249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13398): Terminated: ok {rc=0} 13:55:14.197730 --- ParallelTerminationStrategy: PID 13401 died... 13:55:14.217634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13401): Terminated: ok {rc=0} 13:55:14.263892 --- ParallelTerminationStrategy: PID 13404 died... 13:55:14.283384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13404): Terminated: ok {rc=0} 13:55:14.371211 bus /sierra_3: Setting Powered False 13:55:15.468010 bus /sierra_3: Setting Powered False 13:55:16.591403 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 emergency:nanobts+band-900 --------------------------------------------------------------------- 13:55:17.852301 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:55:17.858175 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 13:55:17.891598 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 13:55:17.918706 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 13:55:18.004751 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 13:55:18.037566 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 13:55:18.065315 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 13:55:18.650821 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2360 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 13:55:18.655898 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:55:18.667112 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 13:55:18.715348 tst emergency_mo_mt_call.py: using LAC 21921 13:55:18.835741 tst emergency_mo_mt_call.py: using RAC 246 13:55:18.958643 tst emergency_mo_mt_call.py: using CellId 21921 13:55:19.080487 tst emergency_mo_mt_call.py: using BVCI 21922 13:55:19.192690 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:55:19.203966 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:55:19.214912 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:55:19.226531 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:55:19.237748 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:55:19.248800 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 13:55:19.361937 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 13:55:19.475410 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:19.926604 run create_hlr_db(pid=13410): Launched 13:55:20.046052 bus /sierra_2: Setting Powered False 13:55:21.105092 run create_hlr_db(pid=13410): Terminated: ok {rc=0} 13:55:21.511916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13412): Launched 13:55:21.802389 run osmo-hlr_10.42.42.2(pid=13413): Launched 13:55:21.910971 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:22.406729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13415): Launched 13:55:22.695104 run osmo-stp_10.42.42.5(pid=13416): Launched 13:55:22.816750 tst emergency_mo_mt_call.py: using MSISDN 7238 13:55:22.965440 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:23.486047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13418): Launched 13:55:23.774546 run osmo-msc_10.42.42.6(pid=13419): Launched 13:55:23.935640 run osmo-stp_10.42.42.5(pid=13416): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13416)] 13:55:24.058281 run osmo-stp_10.42.42.5(pid=13416): stdout: | (launched: 2022-12-09_13:55:22.641851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:24.186074 run osmo-stp_10.42.42.5(pid=13416): stderr: | 20221209135522810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135522811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135522811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135522811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135522812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135522812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135522812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:24.306945 run osmo-stp_10.42.42.5(pid=13416): stdout: | (launched: 2022-12-09_13:55:22.641851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:24.421526 run osmo-stp_10.42.42.5(pid=13416): stderr: | 20221209135522810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135522811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135522811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135522811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135522812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135522812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135522812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:24.558534 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=13416): Process ended prematurely: osmo-stp_10.42.42.5(pid=13416) [trial-2360↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13416)] [trial-2360↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 13:55:24.566688 tst emergency_mo_mt_call.py:19: Test FAILED (5.9 sec) 13:55:24.592234 run osmo-hlr_10.42.42.2(pid=13413): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13413)] 13:55:24.638818 run osmo-hlr_10.42.42.2(pid=13413): stdout: | (launched: 2022-12-09_13:55:21.748366) 13:55:24.687176 run osmo-hlr_10.42.42.2(pid=13413): stderr: | 20221209135521920 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135521920 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135521920 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135521920 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135521920 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135521920 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135521932 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135521941 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135521941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135521941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:24.754861 run osmo-msc_10.42.42.6(pid=13419): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13419)] 13:55:24.801444 run osmo-msc_10.42.42.6(pid=13419): stdout: | (launched: 2022-12-09_13:55:23.721290) 13:55:24.849565 run osmo-msc_10.42.42.6(pid=13419): stderr: | 20221209135523990 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209135523990 DLGLOBAL DEBUG validating counter group 0x7f5ad2c7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209135523990 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209135523990 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209135523991 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209135523991 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209135523993 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209135523993 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209135523993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209135523993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:24.898688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13412): Terminating (SIGTERM) 13:55:24.937558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13415): Terminating (SIGTERM) 13:55:24.976310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13418): Terminating (SIGTERM) 13:55:25.015361 --- ParallelTerminationStrategy: PID 13412 died... 13:55:25.034288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13412): Terminated: ok {rc=0} 13:55:25.077265 --- ParallelTerminationStrategy: PID 13415 died... 13:55:25.095537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13415): Terminated: ok {rc=0} 13:55:25.138442 --- ParallelTerminationStrategy: PID 13418 died... 13:55:25.156717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13418): Terminated: ok {rc=0} 13:55:25.240666 bus /sierra_3: Setting Powered False 13:55:26.339108 bus /sierra_3: Setting Powered False 13:55:27.450879 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 13:55:28.536042 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:55:28.547764 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 13:55:28.598555 tst emergency_preemptive_call.py: using LAC 21922 13:55:28.713279 tst emergency_preemptive_call.py: using RAC 247 13:55:28.827007 tst emergency_preemptive_call.py: using CellId 21922 13:55:28.942929 tst emergency_preemptive_call.py: using BVCI 21923 13:55:29.047838 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:55:29.058749 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:55:29.069372 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:55:29.079957 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:55:29.090523 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:55:29.101139 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 13:55:29.215699 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 13:55:29.330910 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 13:55:29.445090 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 13:55:29.561502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:30.043425 run create_hlr_db(pid=13421): Launched 13:55:30.162687 bus /sierra_2: Setting Powered False 13:55:31.240425 run create_hlr_db(pid=13421): Terminated: ok {rc=0} 13:55:31.698498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13423): Launched 13:55:32.025716 run osmo-hlr_10.42.42.2(pid=13424): Launched 13:55:32.180898 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:32.773858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13426): Launched 13:55:33.063367 run osmo-stp_10.42.42.5(pid=13427): Launched 13:55:33.182520 tst emergency_preemptive_call.py: using MSISDN 7239 13:55:33.330322 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:33.850221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13429): Launched 13:55:34.138029 run osmo-msc_10.42.42.6(pid=13430): Launched 13:55:34.298663 run osmo-stp_10.42.42.5(pid=13427): ERR: Terminated: ERROR {rc=1} [trial-2360↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13427)] 13:55:34.420709 run osmo-stp_10.42.42.5(pid=13427): stdout: | (launched: 2022-12-09_13:55:33.009710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:34.547665 run osmo-stp_10.42.42.5(pid=13427): stderr: | 20221209135533177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135533177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135533177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135533178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135533178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135533178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135533178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:34.666775 run osmo-stp_10.42.42.5(pid=13427): stdout: | (launched: 2022-12-09_13:55:33.009710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:34.779685 run osmo-stp_10.42.42.5(pid=13427): stderr: | 20221209135533177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135533177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135533177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135533178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135533178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135533178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135533178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:34.915145 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=13427): Process ended prematurely: osmo-stp_10.42.42.5(pid=13427) [trial-2360↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13427)] [trial-2360↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 13:55:34.923491 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 13:55:34.949172 run osmo-hlr_10.42.42.2(pid=13424): ERR: Terminated: ERROR {rc=237} [trial-2360↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13424)] 13:55:34.996716 run osmo-hlr_10.42.42.2(pid=13424): stdout: | (launched: 2022-12-09_13:55:31.950131) 13:55:35.045227 run osmo-hlr_10.42.42.2(pid=13424): stderr: | 20221209135532344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135532344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135532344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135532344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135532344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135532345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135532359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135532368 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135532368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135532368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:35.113358 run osmo-msc_10.42.42.6(pid=13430): ERR: Terminated: ERROR {rc=2} [trial-2360↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13430)] 13:55:35.160190 run osmo-msc_10.42.42.6(pid=13430): stdout: | (launched: 2022-12-09_13:55:34.085240) 13:55:35.208520 run osmo-msc_10.42.42.6(pid=13430): stderr: | 20221209135534358 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209135534358 DLGLOBAL DEBUG validating counter group 0x7fa4f74c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209135534358 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209135534359 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209135534359 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209135534359 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209135534361 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209135534361 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209135534361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209135534361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:35.257211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13423): Terminating (SIGTERM) 13:55:35.296254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13426): Terminating (SIGTERM) 13:55:35.335362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13429): Terminating (SIGTERM) 13:55:35.374634 --- ParallelTerminationStrategy: PID 13423 died... 13:55:35.393561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13423): Terminated: ok {rc=0} 13:55:35.436789 --- ParallelTerminationStrategy: PID 13426 died... 13:55:35.455300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13426): Terminated: ok {rc=0} 13:55:35.498386 --- ParallelTerminationStrategy: PID 13429 died... 13:55:35.516881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13429): Terminated: ok {rc=0} 13:55:35.600618 bus /sierra_9: Setting Powered False 13:55:36.698820 bus /sierra_9: Setting Powered False 13:55:37.813561 bus /sierra_8: Setting Powered False 13:55:38.913133 bus /sierra_8: Setting Powered False 13:55:40.030808 bus /sierra_3: Setting Powered False 13:55:41.126917 bus /sierra_3: Setting Powered False 13:55:42.237964 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:nanobts+band-900 --------------------------------------------------------------------- 13:55:43.512414 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:55:43.518332 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 13:55:43.552004 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 13:55:43.591538 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 13:55:43.678896 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 13:55:43.711771 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 13:55:43.750726 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 13:55:44.342579 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 13:55:44.393497 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:44.404388 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 13:55:44.456315 tst cs_paging_gprs_active.py: using LAC 21923 13:55:44.578348 tst cs_paging_gprs_active.py: using RAC 248 13:55:44.698746 tst cs_paging_gprs_active.py: using CellId 21923 13:55:44.821157 tst cs_paging_gprs_active.py: using BVCI 21924 13:55:44.934090 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:44.945199 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:44.955994 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:44.967071 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:44.978146 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:44.989195 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:45.000268 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:45.011231 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:45.022486 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:55:45.137545 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:55:45.252830 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:55:45.449257 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:55:45.741549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13435): Launched 13:55:46.017641 run iperf3-srv_10.42.42.10(pid=13436): Launched 13:55:46.170597 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:55:46.387732 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:55:46.719874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13437): Launched 13:55:47.006720 run iperf3-srv_10.42.42.10(pid=13438): Launched 13:55:47.135708 tst cs_paging_gprs_active.py:38: start network... 13:55:47.348922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:47.832638 run create_hlr_db(pid=13439): Launched 13:55:47.950861 bus /sierra_2: Setting Powered False 13:55:49.012226 run create_hlr_db(pid=13439): Terminated: ok {rc=0} 13:55:49.428932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13441): Launched 13:55:49.719508 run osmo-hlr_10.42.42.2(pid=13442): Launched 13:55:49.830529 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:50.345022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13444): Launched 13:55:50.634454 run osmo-stp_10.42.42.5(pid=13445): Launched 13:55:50.745531 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:55:51.248457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13447): Launched 13:55:51.359967 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:55:51.605231 run patchelf(pid=13448): Launched 13:55:51.766267 run osmo-stp_10.42.42.5(pid=13445): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13445)] 13:55:51.888742 run osmo-stp_10.42.42.5(pid=13445): stdout: | (launched: 2022-12-09_13:55:50.581869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:52.013223 run osmo-stp_10.42.42.5(pid=13445): stderr: | 20221209135550746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135550746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135550747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135550747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135550747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135550748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135550748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:52.137630 run osmo-stp_10.42.42.5(pid=13445): stdout: | (launched: 2022-12-09_13:55:50.581869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:52.256352 run osmo-stp_10.42.42.5(pid=13445): stderr: | 20221209135550746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135550746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135550747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135550747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135550747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135550748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135550748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:52.397202 run patchelf(pid=13448): Terminating (SIGINT) 13:55:52.559373 run patchelf(pid=13448): Terminated: ok {rc=0} 13:55:52.676296 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13445): Process ended prematurely: osmo-stp_10.42.42.5(pid=13445) [trial-2360↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13445)] [trial-2360↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 13:55:52.685638 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 13:55:52.712003 run osmo-hlr_10.42.42.2(pid=13442): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13442)] 13:55:52.758294 run osmo-hlr_10.42.42.2(pid=13442): stdout: | (launched: 2022-12-09_13:55:49.666638) 13:55:52.806236 run osmo-hlr_10.42.42.2(pid=13442): stderr: | 20221209135549839 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135549839 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135549839 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135549839 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135549839 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135549839 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135549851 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135549860 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135549860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135549860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:52.854684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13435): Terminating (SIGTERM) 13:55:52.893479 run iperf3-srv_10.42.42.10(pid=13436): Terminating (SIGTERM) 13:55:52.932091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13437): Terminating (SIGTERM) 13:55:52.970696 run iperf3-srv_10.42.42.10(pid=13438): Terminating (SIGTERM) 13:55:53.009230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13441): Terminating (SIGTERM) 13:55:53.047862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13444): Terminating (SIGTERM) 13:55:53.086549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13447): Terminating (SIGTERM) 13:55:53.126012 --- ParallelTerminationStrategy: PID 13435 died... 13:55:53.144738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13435): Terminated: ok {rc=0} 13:55:53.187720 --- ParallelTerminationStrategy: PID 13436 died... 13:55:53.205951 run iperf3-srv_10.42.42.10(pid=13436): Terminated {rc=256} 13:55:53.248744 --- ParallelTerminationStrategy: PID 13437 died... 13:55:53.267068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13437): Terminated: ok {rc=0} 13:55:53.309531 --- ParallelTerminationStrategy: PID 13438 died... 13:55:53.327725 run iperf3-srv_10.42.42.10(pid=13438): Terminated {rc=256} 13:55:53.370390 --- ParallelTerminationStrategy: PID 13441 died... 13:55:53.388347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13441): Terminated: ok {rc=0} 13:55:53.431073 --- ParallelTerminationStrategy: PID 13444 died... 13:55:53.449392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13444): Terminated: ok {rc=0} 13:55:53.491855 --- ParallelTerminationStrategy: PID 13447 died... 13:55:53.510169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13447): Terminated: ok {rc=0} 13:55:53.591730 bus /gobi_0: Setting Powered False 13:55:54.687336 bus /gobi_0: Setting Powered False 13:55:55.800390 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 13:55:56.944083 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:56.955832 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 13:55:57.007689 tst iperf3.py: using LAC 21924 13:55:57.123664 tst iperf3.py: using RAC 249 13:55:57.238759 tst iperf3.py: using CellId 21924 13:55:57.353492 tst iperf3.py: using BVCI 21925 13:55:57.469399 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:57.480609 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:57.491761 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:57.503254 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:57.514532 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:57.526100 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:57.537810 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:57.548871 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:55:57.560288 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:55:57.673556 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:55:57.868198 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:55:58.160403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13449): Launched 13:55:58.411954 run iperf3-srv_10.42.42.10(pid=13450): Launched 13:55:58.520463 tst iperf3.py:8: start network... 13:55:58.714523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:59.163000 run create_hlr_db(pid=13451): Launched 13:55:59.283062 bus /gobi_6: Setting Powered False 13:56:00.341125 run create_hlr_db(pid=13451): Terminated: ok {rc=0} 13:56:00.746250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13453): Launched 13:56:01.075340 run osmo-hlr_10.42.42.2(pid=13454): Launched 13:56:01.281486 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:01.934836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13456): Launched 13:56:02.265493 run osmo-stp_10.42.42.5(pid=13457): Launched 13:56:02.386285 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:56:02.927691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13459): Launched 13:56:03.046924 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:56:03.310698 run patchelf(pid=13460): Launched 13:56:03.483386 run osmo-stp_10.42.42.5(pid=13457): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13457)] 13:56:03.615837 run osmo-stp_10.42.42.5(pid=13457): stdout: | (launched: 2022-12-09_13:56:02.208786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:03.749612 run osmo-stp_10.42.42.5(pid=13457): stderr: | 20221209135602393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135602393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135602394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135602394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135602395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135602395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135602395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:03.883713 run osmo-stp_10.42.42.5(pid=13457): stdout: | (launched: 2022-12-09_13:56:02.208786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:04.012244 run osmo-stp_10.42.42.5(pid=13457): stderr: | 20221209135602393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135602393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135602394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135602394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135602395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135602395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135602395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:04.165244 run patchelf(pid=13460): Terminating (SIGINT) 13:56:04.339713 run patchelf(pid=13460): Terminated: ok {rc=0} 13:56:04.465557 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13457): Process ended prematurely: osmo-stp_10.42.42.5(pid=13457) [trial-2360↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13457)] [trial-2360↪gprs:nanobts+band-900↪iperf3.py:8] 13:56:04.475540 tst iperf3.py:8: Test FAILED (7.6 sec) 13:56:04.504429 run osmo-hlr_10.42.42.2(pid=13454): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13454)] 13:56:04.554441 run osmo-hlr_10.42.42.2(pid=13454): stdout: | (launched: 2022-12-09_13:56:01.012388) 13:56:04.606052 run osmo-hlr_10.42.42.2(pid=13454): stderr: | 20221209135601383 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135601383 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135601383 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135601384 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135601384 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135601384 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135601403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135601411 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135601411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135601411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:04.657991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13449): Terminating (SIGTERM) 13:56:04.699602 run iperf3-srv_10.42.42.10(pid=13450): Terminating (SIGTERM) 13:56:04.741327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13453): Terminating (SIGTERM) 13:56:04.782993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13456): Terminating (SIGTERM) 13:56:04.824478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13459): Terminating (SIGTERM) 13:56:04.866384 --- ParallelTerminationStrategy: PID 13449 died... 13:56:04.886198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13449): Terminated: ok {rc=0} 13:56:04.932124 --- ParallelTerminationStrategy: PID 13450 died... 13:56:04.951422 run iperf3-srv_10.42.42.10(pid=13450): Terminated {rc=256} 13:56:04.996773 --- ParallelTerminationStrategy: PID 13453 died... 13:56:05.016420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13453): Terminated: ok {rc=0} 13:56:05.062202 --- ParallelTerminationStrategy: PID 13456 died... 13:56:05.081791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13456): Terminated: ok {rc=0} 13:56:05.127678 --- ParallelTerminationStrategy: PID 13459 died... 13:56:05.146943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13459): Terminated: ok {rc=0} 13:56:05.233393 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 13:56:06.375343 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:06.386299 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 13:56:06.433775 tst iperf3m4.py: using LAC 21925 13:56:06.547292 tst iperf3m4.py: using RAC 250 13:56:06.661372 tst iperf3m4.py: using CellId 21925 13:56:06.780456 tst iperf3m4.py: using BVCI 21926 13:56:06.887033 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:06.897630 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:06.907865 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:06.918202 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:06.928460 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:06.938827 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:06.949197 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:06.959369 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:06.969743 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:56:07.081867 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:56:07.201142 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:56:07.317188 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:56:07.432767 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:56:07.627558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:56:07.918401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13461): Launched 13:56:08.170466 run iperf3-srv_10.42.42.10(pid=13462): Launched 13:56:08.279331 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:56:08.472183 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:56:08.762223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13463): Launched 13:56:09.013589 run iperf3-srv_10.42.42.10(pid=13464): Launched 13:56:09.122098 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:56:09.315752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:56:09.606475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13465): Launched 13:56:09.857643 run iperf3-srv_10.42.42.10(pid=13466): Launched 13:56:09.965912 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:56:10.158817 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:56:10.449036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13467): Launched 13:56:10.701469 run iperf3-srv_10.42.42.10(pid=13468): Launched 13:56:10.810151 tst iperf3m4.py:8: start network... 13:56:11.002831 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:11.453120 run create_hlr_db(pid=13469): Launched 13:56:11.572078 bus /gobi_6: Setting Powered False 13:56:12.630951 run create_hlr_db(pid=13469): Terminated: ok {rc=0} 13:56:13.056143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13471): Launched 13:56:13.368705 run osmo-hlr_10.42.42.2(pid=13472): Launched 13:56:13.488225 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:14.029910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13474): Launched 13:56:14.342073 run osmo-stp_10.42.42.5(pid=13475): Launched 13:56:14.462872 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:56:15.010380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13477): Launched 13:56:15.132703 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:56:15.401379 run patchelf(pid=13478): Launched 13:56:15.577648 run osmo-stp_10.42.42.5(pid=13475): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13475)] 13:56:15.712615 run osmo-stp_10.42.42.5(pid=13475): stdout: | (launched: 2022-12-09_13:56:14.284704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:15.849593 run osmo-stp_10.42.42.5(pid=13475): stderr: | 20221209135614470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135614470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135614471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135614471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135614472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135614472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135614472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:15.988623 run osmo-stp_10.42.42.5(pid=13475): stdout: | (launched: 2022-12-09_13:56:14.284704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:16.122880 run osmo-stp_10.42.42.5(pid=13475): stderr: | 20221209135614470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135614470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135614471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135614471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135614472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135614472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135614472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:16.281353 run patchelf(pid=13478): Terminating (SIGINT) 13:56:16.462769 run patchelf(pid=13478): Terminated: ok {rc=0} 13:56:16.594228 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13475): Process ended prematurely: osmo-stp_10.42.42.5(pid=13475) [trial-2360↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13475)] [trial-2360↪gprs:nanobts+band-900↪iperf3m4.py:8] 13:56:16.605265 tst iperf3m4.py:8: Test FAILED (10.3 sec) 13:56:16.636505 run osmo-hlr_10.42.42.2(pid=13472): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13472)] 13:56:16.688621 run osmo-hlr_10.42.42.2(pid=13472): stdout: | (launched: 2022-12-09_13:56:13.311918) 13:56:16.742130 run osmo-hlr_10.42.42.2(pid=13472): stderr: | 20221209135613504 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135613504 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135613504 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135613504 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135613504 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135613504 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135613517 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135613525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135613525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135613525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:16.793680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13461): Terminating (SIGTERM) 13:56:16.839017 run iperf3-srv_10.42.42.10(pid=13462): Terminating (SIGTERM) 13:56:16.885313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13463): Terminating (SIGTERM) 13:56:16.929753 run iperf3-srv_10.42.42.10(pid=13464): Terminating (SIGTERM) 13:56:16.976299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13465): Terminating (SIGTERM) 13:56:17.020739 run iperf3-srv_10.42.42.10(pid=13466): Terminating (SIGTERM) 13:56:17.067276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13467): Terminating (SIGTERM) 13:56:17.111957 run iperf3-srv_10.42.42.10(pid=13468): Terminating (SIGTERM) 13:56:17.158532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13471): Terminating (SIGTERM) 13:56:17.202338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13474): Terminating (SIGTERM) 13:56:17.245755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13477): Terminating (SIGTERM) 13:56:17.289308 --- ParallelTerminationStrategy: PID 13461 died... 13:56:17.310369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13461): Terminated: ok {rc=0} 13:56:17.357051 --- ParallelTerminationStrategy: PID 13462 died... 13:56:17.376619 run iperf3-srv_10.42.42.10(pid=13462): Terminated {rc=256} 13:56:17.422930 --- ParallelTerminationStrategy: PID 13463 died... 13:56:17.442473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13463): Terminated: ok {rc=0} 13:56:17.489592 --- ParallelTerminationStrategy: PID 13464 died... 13:56:17.509132 run iperf3-srv_10.42.42.10(pid=13464): Terminated {rc=256} 13:56:17.555124 --- ParallelTerminationStrategy: PID 13465 died... 13:56:17.574697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13465): Terminated: ok {rc=0} 13:56:17.620916 --- ParallelTerminationStrategy: PID 13466 died... 13:56:17.640472 run iperf3-srv_10.42.42.10(pid=13466): Terminated {rc=256} 13:56:17.686614 --- ParallelTerminationStrategy: PID 13467 died... 13:56:17.706199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13467): Terminated: ok {rc=0} 13:56:17.752438 --- ParallelTerminationStrategy: PID 13468 died... 13:56:17.771990 run iperf3-srv_10.42.42.10(pid=13468): Terminated {rc=256} 13:56:17.817971 --- ParallelTerminationStrategy: PID 13471 died... 13:56:17.837481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13471): Terminated: ok {rc=0} 13:56:17.883825 --- ParallelTerminationStrategy: PID 13474 died... 13:56:17.903473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13474): Terminated: ok {rc=0} 13:56:17.950000 --- ParallelTerminationStrategy: PID 13477 died... 13:56:17.969768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13477): Terminated: ok {rc=0} 13:56:18.057678 bus /gobi_4: Setting Powered False 13:56:19.155723 bus /gobi_4: Setting Powered False 13:56:20.273534 bus /gobi_1: Setting Powered False 13:56:21.370560 bus /gobi_1: Setting Powered False 13:56:22.482113 bus /gobi_0: Setting Powered False 13:56:23.578384 bus /gobi_0: Setting Powered False 13:56:24.694271 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-900 ping.py ---------------------------------------------- 13:56:25.795319 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:25.806895 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 13:56:25.855245 tst ping.py: using LAC 21926 13:56:25.978751 tst ping.py: using RAC 251 13:56:26.102374 tst ping.py: using CellId 21926 13:56:26.225295 tst ping.py: using BVCI 21927 13:56:26.338666 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:26.349923 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:26.360855 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:26.371963 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:26.383005 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:26.394065 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:26.405366 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:26.416492 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:56:26.528694 tst ping.py:19: start network... 13:56:26.723040 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:27.172030 run create_hlr_db(pid=13479): Launched 13:56:27.291112 bus /gobi_6: Setting Powered False 13:56:28.349471 run create_hlr_db(pid=13479): Terminated: ok {rc=0} 13:56:28.775165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13481): Launched 13:56:29.085274 run osmo-hlr_10.42.42.2(pid=13482): Launched 13:56:29.203720 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:29.743968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13484): Launched 13:56:30.053894 run osmo-stp_10.42.42.5(pid=13485): Launched 13:56:30.173473 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:56:30.711273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13487): Launched 13:56:30.831491 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:56:31.125695 run patchelf(pid=13488): Launched 13:56:31.308307 run osmo-stp_10.42.42.5(pid=13485): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13485)] 13:56:31.444728 run osmo-stp_10.42.42.5(pid=13485): stdout: | (launched: 2022-12-09_13:56:29.997350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:31.582691 run osmo-stp_10.42.42.5(pid=13485): stderr: | 20221209135630186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135630186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135630187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135630187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135630187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135630187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135630188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:31.721170 run osmo-stp_10.42.42.5(pid=13485): stdout: | (launched: 2022-12-09_13:56:29.997350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:31.852887 run osmo-stp_10.42.42.5(pid=13485): stderr: | 20221209135630186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135630186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135630187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135630187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135630187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135630187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135630188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:32.009530 run patchelf(pid=13488): Terminating (SIGINT) 13:56:32.189551 run patchelf(pid=13488): Terminated: ok {rc=0} 13:56:32.318993 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13485): Process ended prematurely: osmo-stp_10.42.42.5(pid=13485) [trial-2360↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13485)] [trial-2360↪gprs:nanobts+band-900↪ping.py:22] 13:56:32.328375 tst ping.py:22: Test FAILED (6.5 sec) 13:56:32.357301 run osmo-hlr_10.42.42.2(pid=13482): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13482)] 13:56:32.407959 run osmo-hlr_10.42.42.2(pid=13482): stdout: | (launched: 2022-12-09_13:56:29.028780) 13:56:32.460016 run osmo-hlr_10.42.42.2(pid=13482): stderr: | 20221209135629224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135629224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135629224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135629224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135629224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135629224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135629237 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135629245 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135629246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135629246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:32.512550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13481): Terminating (SIGTERM) 13:56:32.554668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13484): Terminating (SIGTERM) 13:56:32.597046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13487): Terminating (SIGTERM) 13:56:32.639572 --- ParallelTerminationStrategy: PID 13481 died... 13:56:32.659737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13481): Terminated: ok {rc=0} 13:56:32.706658 --- ParallelTerminationStrategy: PID 13484 died... 13:56:32.726425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13484): Terminated: ok {rc=0} 13:56:32.773225 --- ParallelTerminationStrategy: PID 13487 died... 13:56:32.792700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13487): Terminated: ok {rc=0} 13:56:32.880642 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 13:56:33.967713 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:33.979669 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 13:56:34.029779 tst ping_idle_ping.py: using LAC 21927 13:56:34.149390 tst ping_idle_ping.py: using RAC 252 13:56:34.264807 tst ping_idle_ping.py: using CellId 21927 13:56:34.381125 tst ping_idle_ping.py: using BVCI 21928 13:56:34.488107 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:34.498672 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:34.509063 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:34.520030 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:34.530897 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:34.541800 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:34.552693 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 13:56:34.563775 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 13:56:34.681157 tst ping_idle_ping.py:24: start network... 13:56:34.891025 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:35.377328 run create_hlr_db(pid=13489): Launched 13:56:35.496878 bus /gobi_6: Setting Powered False 13:56:36.559985 run create_hlr_db(pid=13489): Terminated: ok {rc=0} 13:56:36.979856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13491): Launched 13:56:37.272602 run osmo-hlr_10.42.42.2(pid=13492): Launched 13:56:37.384362 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:37.888557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13494): Launched 13:56:38.179956 run osmo-stp_10.42.42.5(pid=13495): Launched 13:56:38.290503 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:56:38.793719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13497): Launched 13:56:38.906028 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:56:39.152180 run patchelf(pid=13498): Launched 13:56:39.314246 run osmo-stp_10.42.42.5(pid=13495): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13495)] 13:56:39.438519 run osmo-stp_10.42.42.5(pid=13495): stdout: | (launched: 2022-12-09_13:56:38.126190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:39.564106 run osmo-stp_10.42.42.5(pid=13495): stderr: | 20221209135638296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135638296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135638296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135638297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135638297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135638297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135638297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:39.689891 run osmo-stp_10.42.42.5(pid=13495): stdout: | (launched: 2022-12-09_13:56:38.126190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:39.809385 run osmo-stp_10.42.42.5(pid=13495): stderr: | 20221209135638296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135638296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135638296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135638297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135638297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135638297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135638297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:39.951005 run patchelf(pid=13498): Terminating (SIGINT) 13:56:40.115028 run patchelf(pid=13498): Terminated: ok {rc=0} 13:56:40.232906 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13495): Process ended prematurely: osmo-stp_10.42.42.5(pid=13495) [trial-2360↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13495)] [trial-2360↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 13:56:40.241653 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 13:56:40.268125 run osmo-hlr_10.42.42.2(pid=13492): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13492)] 13:56:40.315106 run osmo-hlr_10.42.42.2(pid=13492): stdout: | (launched: 2022-12-09_13:56:37.218569) 13:56:40.363729 run osmo-hlr_10.42.42.2(pid=13492): stderr: | 20221209135637392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135637392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135637392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135637392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135637392 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135637392 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135637404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135637413 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135637413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135637413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:40.412799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13491): Terminating (SIGTERM) 13:56:40.452384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13494): Terminating (SIGTERM) 13:56:40.491547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13497): Terminating (SIGTERM) 13:56:40.531191 --- ParallelTerminationStrategy: PID 13491 died... 13:56:40.550100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13491): Terminated: ok {rc=0} 13:56:40.593595 --- ParallelTerminationStrategy: PID 13494 died... 13:56:40.611910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13494): Terminated: ok {rc=0} 13:56:40.655604 --- ParallelTerminationStrategy: PID 13497 died... 13:56:40.674383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13497): Terminated: ok {rc=0} 13:56:40.759546 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 13:56:42.065359 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:56:42.071923 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:56:42.107075 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:56:42.144710 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:56:42.229697 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:56:42.261275 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:56:42.299093 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:56:42.902710 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:56:42.956336 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:42.967817 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:56:43.017861 tst cs_paging_gprs_active.py: using LAC 21928 13:56:43.144325 tst cs_paging_gprs_active.py: using RAC 253 13:56:43.270004 tst cs_paging_gprs_active.py: using CellId 21928 13:56:43.395738 tst cs_paging_gprs_active.py: using BVCI 21929 13:56:43.513080 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:43.524744 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:43.535766 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:43.547063 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:43.558380 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:43.569768 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:43.581194 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:43.592360 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:43.603777 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:56:43.718104 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:56:43.833389 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:56:44.031981 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:56:44.330083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13503): Launched 13:56:44.587648 run iperf3-srv_10.42.42.10(pid=13504): Launched 13:56:44.698029 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:56:44.895603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:56:45.193140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13505): Launched 13:56:45.451057 run iperf3-srv_10.42.42.10(pid=13506): Launched 13:56:45.562050 tst cs_paging_gprs_active.py:38: start network... 13:56:45.759744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:46.245237 run create_hlr_db(pid=13507): Launched 13:56:46.399984 bus /gobi_6: Setting Powered False 13:56:47.458507 run create_hlr_db(pid=13507): Terminated: ok {rc=0} 13:56:47.870220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13509): Launched 13:56:48.165389 run osmo-hlr_10.42.42.2(pid=13510): Launched 13:56:48.277760 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:48.786745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13512): Launched 13:56:49.081339 run osmo-stp_10.42.42.5(pid=13513): Launched 13:56:49.194627 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:56:49.709183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13515): Launched 13:56:49.822013 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:56:50.071679 run patchelf(pid=13516): Launched 13:56:50.236240 run osmo-stp_10.42.42.5(pid=13513): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13513)] 13:56:50.361732 run osmo-stp_10.42.42.5(pid=13513): stdout: | (launched: 2022-12-09_13:56:49.027143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:50.488544 run osmo-stp_10.42.42.5(pid=13513): stderr: | 20221209135649193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135649194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135649194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135649194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135649195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135649195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135649195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:50.615452 run osmo-stp_10.42.42.5(pid=13513): stdout: | (launched: 2022-12-09_13:56:49.027143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:50.736344 run osmo-stp_10.42.42.5(pid=13513): stderr: | 20221209135649193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135649194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135649194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135649194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135649195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135649195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135649195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:50.880232 run patchelf(pid=13516): Terminating (SIGINT) 13:56:51.046149 run patchelf(pid=13516): Terminated: ok {rc=0} 13:56:51.166068 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13513): Process ended prematurely: osmo-stp_10.42.42.5(pid=13513) [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13513)] [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:56:51.175306 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 13:56:51.201988 run osmo-hlr_10.42.42.2(pid=13510): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13510)] 13:56:51.248629 run osmo-hlr_10.42.42.2(pid=13510): stdout: | (launched: 2022-12-09_13:56:48.111038) 13:56:51.297048 run osmo-hlr_10.42.42.2(pid=13510): stderr: | 20221209135648285 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135648285 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135648285 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135648286 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135648286 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135648286 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135648301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135648311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135648311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135648311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:51.345860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13503): Terminating (SIGTERM) 13:56:51.384915 run iperf3-srv_10.42.42.10(pid=13504): Terminating (SIGTERM) 13:56:51.423896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13505): Terminating (SIGTERM) 13:56:51.462820 run iperf3-srv_10.42.42.10(pid=13506): Terminating (SIGTERM) 13:56:51.501634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13509): Terminating (SIGTERM) 13:56:51.540644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13512): Terminating (SIGTERM) 13:56:51.580062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13515): Terminating (SIGTERM) 13:56:51.619531 --- ParallelTerminationStrategy: PID 13503 died... 13:56:51.638486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13503): Terminated: ok {rc=0} 13:56:51.681807 --- ParallelTerminationStrategy: PID 13504 died... 13:56:51.699937 run iperf3-srv_10.42.42.10(pid=13504): Terminated {rc=256} 13:56:51.743258 --- ParallelTerminationStrategy: PID 13505 died... 13:56:51.761692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13505): Terminated: ok {rc=0} 13:56:51.804704 --- ParallelTerminationStrategy: PID 13506 died... 13:56:51.823130 run iperf3-srv_10.42.42.10(pid=13506): Terminated {rc=256} 13:56:51.866132 --- ParallelTerminationStrategy: PID 13509 died... 13:56:51.884510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13509): Terminated: ok {rc=0} 13:56:51.927610 --- ParallelTerminationStrategy: PID 13512 died... 13:56:51.945949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13512): Terminated: ok {rc=0} 13:56:51.989111 --- ParallelTerminationStrategy: PID 13515 died... 13:56:52.007505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13515): Terminated: ok {rc=0} 13:56:52.092768 bus /gobi_0: Setting Powered False 13:56:53.192328 bus /gobi_0: Setting Powered False 13:56:54.306870 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:56:55.451142 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:55.462409 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:56:55.511661 tst iperf3.py: using LAC 21929 13:56:55.627682 tst iperf3.py: using RAC 254 13:56:55.752739 tst iperf3.py: using CellId 21929 13:56:55.875980 tst iperf3.py: using BVCI 21930 13:56:55.984583 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:55.995364 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:56.005939 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:56.016430 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:56.026838 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:56.037258 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:56.047812 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:56.058317 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:56:56.068835 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:56:56.184536 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:56:56.383501 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:56:56.680638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13517): Launched 13:56:56.939152 run iperf3-srv_10.42.42.10(pid=13518): Launched 13:56:57.050080 tst iperf3.py:8: start network... 13:56:57.248193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:57.710011 run create_hlr_db(pid=13519): Launched 13:56:57.832062 bus /gobi_6: Setting Powered False 13:56:58.891726 run create_hlr_db(pid=13519): Terminated: ok {rc=0} 13:56:59.325518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13521): Launched 13:56:59.643932 run osmo-hlr_10.42.42.2(pid=13522): Launched 13:56:59.766466 run osmo-stp_10.42.42.5: Starting osmo-stp 13:57:00.318006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13524): Launched 13:57:00.635027 run osmo-stp_10.42.42.5(pid=13525): Launched 13:57:00.757053 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:57:01.397664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13527): Launched 13:57:01.527081 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:57:01.813993 run patchelf(pid=13528): Launched 13:57:01.998671 run osmo-stp_10.42.42.5(pid=13525): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13525)] 13:57:02.137128 run osmo-stp_10.42.42.5(pid=13525): stdout: | (launched: 2022-12-09_13:57:00.577452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:02.275370 run osmo-stp_10.42.42.5(pid=13525): stderr: | 20221209135700766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135700766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135700766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135700767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135700767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135700767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135700767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:02.412012 run osmo-stp_10.42.42.5(pid=13525): stdout: | (launched: 2022-12-09_13:57:00.577452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:02.543179 run osmo-stp_10.42.42.5(pid=13525): stderr: | 20221209135700766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135700766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135700766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135700767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135700767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135700767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135700767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:02.698588 run patchelf(pid=13528): Terminating (SIGINT) 13:57:02.877080 run patchelf(pid=13528): Terminated: ok {rc=0} 13:57:03.005764 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13525): Process ended prematurely: osmo-stp_10.42.42.5(pid=13525) [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13525)] [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 13:57:03.015841 tst iperf3.py:8: Test FAILED (7.6 sec) 13:57:03.044538 run osmo-hlr_10.42.42.2(pid=13522): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13522)] 13:57:03.094837 run osmo-hlr_10.42.42.2(pid=13522): stdout: | (launched: 2022-12-09_13:56:59.586277) 13:57:03.146915 run osmo-hlr_10.42.42.2(pid=13522): stderr: | 20221209135659781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135659782 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135659782 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135659782 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135659782 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135659782 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135659794 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135659803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135659803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135659803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:57:03.199095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13517): Terminating (SIGTERM) 13:57:03.241245 run iperf3-srv_10.42.42.10(pid=13518): Terminating (SIGTERM) 13:57:03.283333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13521): Terminating (SIGTERM) 13:57:03.325535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13524): Terminating (SIGTERM) 13:57:03.367643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13527): Terminating (SIGTERM) 13:57:03.410107 --- ParallelTerminationStrategy: PID 13517 died... 13:57:03.430215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13517): Terminated: ok {rc=0} 13:57:03.476719 --- ParallelTerminationStrategy: PID 13518 died... 13:57:03.496176 run iperf3-srv_10.42.42.10(pid=13518): Terminated {rc=256} 13:57:03.542722 --- ParallelTerminationStrategy: PID 13521 died... 13:57:03.562339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13521): Terminated: ok {rc=0} 13:57:03.608553 --- ParallelTerminationStrategy: PID 13524 died... 13:57:03.628034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13524): Terminated: ok {rc=0} 13:57:03.674304 --- ParallelTerminationStrategy: PID 13527 died... 13:57:03.693913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13527): Terminated: ok {rc=0} 13:57:03.782588 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:57:04.931174 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:04.943139 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:57:04.993630 tst iperf3m4.py: using LAC 21930 13:57:05.111203 tst iperf3m4.py: using RAC 255 13:57:05.231410 tst iperf3m4.py: using CellId 21930 13:57:05.356353 tst iperf3m4.py: using BVCI 21931 13:57:05.471584 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:05.483135 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:05.494206 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:05.505530 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:05.516625 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:05.527867 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:05.539340 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:05.550558 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:05.561965 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:57:05.677175 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:57:05.797480 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:57:05.911733 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:57:06.029139 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:57:06.228787 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:06.526994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13529): Launched 13:57:06.786005 run iperf3-srv_10.42.42.10(pid=13530): Launched 13:57:06.898048 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:57:07.096347 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:07.393745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13531): Launched 13:57:07.651453 run iperf3-srv_10.42.42.10(pid=13532): Launched 13:57:07.764187 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:57:07.961687 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:08.258791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13533): Launched 13:57:08.516525 run iperf3-srv_10.42.42.10(pid=13534): Launched 13:57:08.627899 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:57:08.825531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:09.122611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13535): Launched 13:57:09.380692 run iperf3-srv_10.42.42.10(pid=13536): Launched 13:57:09.492125 tst iperf3m4.py:8: start network... 13:57:09.690382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:57:10.151382 run create_hlr_db(pid=13537): Launched 13:57:10.273158 bus /gobi_6: Setting Powered False 13:57:11.332828 run create_hlr_db(pid=13537): Terminated: ok {rc=0} 13:57:11.767110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13539): Launched 13:57:12.086293 run osmo-hlr_10.42.42.2(pid=13540): Launched 13:57:12.207952 run osmo-stp_10.42.42.5: Starting osmo-stp 13:57:12.721725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13542): Launched 13:57:13.018051 run osmo-stp_10.42.42.5(pid=13543): Launched 13:57:13.130233 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:57:13.639620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13545): Launched 13:57:13.753081 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:57:14.003686 run patchelf(pid=13546): Launched 13:57:14.170997 run osmo-stp_10.42.42.5(pid=13543): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13543)] 13:57:14.298685 run osmo-stp_10.42.42.5(pid=13543): stdout: | (launched: 2022-12-09_13:57:12.963726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:14.427997 run osmo-stp_10.42.42.5(pid=13543): stderr: | 20221209135713130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135713130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135713131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135713131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135713131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135713131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135713132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:14.557108 run osmo-stp_10.42.42.5(pid=13543): stdout: | (launched: 2022-12-09_13:57:12.963726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:14.681140 run osmo-stp_10.42.42.5(pid=13543): stderr: | 20221209135713130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135713130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135713131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135713131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135713131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135713131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135713132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:14.827461 run patchelf(pid=13546): Terminating (SIGINT) 13:57:14.995879 run patchelf(pid=13546): Terminated: ok {rc=0} 13:57:15.117064 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13543): Process ended prematurely: osmo-stp_10.42.42.5(pid=13543) [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13543)] [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 13:57:15.126471 tst iperf3m4.py:8: Test FAILED (10.2 sec) 13:57:15.153724 run osmo-hlr_10.42.42.2(pid=13540): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13540)] 13:57:15.201050 run osmo-hlr_10.42.42.2(pid=13540): stdout: | (launched: 2022-12-09_13:57:12.028339) 13:57:15.249779 run osmo-hlr_10.42.42.2(pid=13540): stderr: | 20221209135712222 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135712222 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135712222 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135712222 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135712222 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135712222 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135712235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135712243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135712243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135712243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:57:15.299076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13529): Terminating (SIGTERM) 13:57:15.338616 run iperf3-srv_10.42.42.10(pid=13530): Terminating (SIGTERM) 13:57:15.377886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13531): Terminating (SIGTERM) 13:57:15.417114 run iperf3-srv_10.42.42.10(pid=13532): Terminating (SIGTERM) 13:57:15.456532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13533): Terminating (SIGTERM) 13:57:15.495785 run iperf3-srv_10.42.42.10(pid=13534): Terminating (SIGTERM) 13:57:15.534755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13535): Terminating (SIGTERM) 13:57:15.573934 run iperf3-srv_10.42.42.10(pid=13536): Terminating (SIGTERM) 13:57:15.612888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13539): Terminating (SIGTERM) 13:57:15.652020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13542): Terminating (SIGTERM) 13:57:15.691134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13545): Terminating (SIGTERM) 13:57:15.730723 --- ParallelTerminationStrategy: PID 13529 died... 13:57:15.749911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13529): Terminated: ok {rc=0} 13:57:15.794074 --- ParallelTerminationStrategy: PID 13530 died... 13:57:15.812654 run iperf3-srv_10.42.42.10(pid=13530): Terminated {rc=256} 13:57:15.866320 --- ParallelTerminationStrategy: PID 13531 died... 13:57:15.885617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13531): Terminated: ok {rc=0} 13:57:15.930333 --- ParallelTerminationStrategy: PID 13532 died... 13:57:15.949459 run iperf3-srv_10.42.42.10(pid=13532): Terminated {rc=256} 13:57:15.993626 --- ParallelTerminationStrategy: PID 13533 died... 13:57:16.022892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13533): Terminated: ok {rc=0} 13:57:16.069592 --- ParallelTerminationStrategy: PID 13534 died... 13:57:16.088802 run iperf3-srv_10.42.42.10(pid=13534): Terminated {rc=256} 13:57:16.133431 --- ParallelTerminationStrategy: PID 13535 died... 13:57:16.153366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13535): Terminated: ok {rc=0} 13:57:16.198281 --- ParallelTerminationStrategy: PID 13536 died... 13:57:16.217605 run iperf3-srv_10.42.42.10(pid=13536): Terminated {rc=256} 13:57:16.262178 --- ParallelTerminationStrategy: PID 13539 died... 13:57:16.281400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13539): Terminated: ok {rc=0} 13:57:16.326906 --- ParallelTerminationStrategy: PID 13542 died... 13:57:16.346802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13542): Terminated: ok {rc=0} 13:57:16.392463 --- ParallelTerminationStrategy: PID 13545 died... 13:57:16.412402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13545): Terminated: ok {rc=0} 13:57:16.497984 bus /gobi_4: Setting Powered False 13:57:17.595542 bus /gobi_4: Setting Powered False 13:57:18.711713 bus /gobi_1: Setting Powered False 13:57:19.808916 bus /gobi_1: Setting Powered False 13:57:20.925108 bus /gobi_0: Setting Powered False 13:57:22.022115 bus /gobi_0: Setting Powered False 13:57:23.138497 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 13:57:24.241537 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:24.253694 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:57:24.304597 tst ping.py: using LAC 21931 13:57:24.430307 tst ping.py: using RAC 1 13:57:24.556084 tst ping.py: using CellId 21931 13:57:24.679799 tst ping.py: using BVCI 21932 13:57:24.794968 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:24.806559 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:24.817945 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:24.829387 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:24.840730 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:24.852184 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:24.863554 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:24.874843 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:57:24.994013 tst ping.py:19: start network... 13:57:25.207219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:57:25.696915 run create_hlr_db(pid=13550): Launched 13:57:25.817824 bus /gobi_6: Setting Powered False 13:57:26.880398 run create_hlr_db(pid=13550): Terminated: ok {rc=0} 13:57:27.323193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13552): Launched 13:57:27.641227 run osmo-hlr_10.42.42.2(pid=13553): Launched 13:57:27.763601 run osmo-stp_10.42.42.5: Starting osmo-stp 13:57:28.281423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13555): Launched 13:57:28.578863 run osmo-stp_10.42.42.5(pid=13556): Launched 13:57:28.690840 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:57:29.202354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13558): Launched 13:57:29.315409 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:57:29.565439 run patchelf(pid=13559): Launched 13:57:29.729791 run osmo-stp_10.42.42.5(pid=13556): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13556)] 13:57:29.854626 run osmo-stp_10.42.42.5(pid=13556): stdout: | (launched: 2022-12-09_13:57:28.523377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:29.981921 run osmo-stp_10.42.42.5(pid=13556): stderr: | 20221209135728695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135728695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135728695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135728696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135728696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135728696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135728696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:30.108731 run osmo-stp_10.42.42.5(pid=13556): stdout: | (launched: 2022-12-09_13:57:28.523377) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:30.230206 run osmo-stp_10.42.42.5(pid=13556): stderr: | 20221209135728695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135728695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135728695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135728696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135728696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135728696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135728696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:30.373732 run patchelf(pid=13559): Terminating (SIGINT) 13:57:30.539435 run patchelf(pid=13559): Terminated: ok {rc=0} 13:57:30.658764 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13556): Process ended prematurely: osmo-stp_10.42.42.5(pid=13556) [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13556)] [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 13:57:30.667540 tst ping.py:22: Test FAILED (6.4 sec) 13:57:30.694223 run osmo-hlr_10.42.42.2(pid=13553): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13553)] 13:57:30.741367 run osmo-hlr_10.42.42.2(pid=13553): stdout: | (launched: 2022-12-09_13:57:27.582952) 13:57:30.790425 run osmo-hlr_10.42.42.2(pid=13553): stderr: | 20221209135727780 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135727780 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135727780 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135727780 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135727780 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135727780 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135727792 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135727800 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135727801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135727801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:57:30.845005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13552): Terminating (SIGTERM) 13:57:30.904037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13555): Terminating (SIGTERM) 13:57:30.956637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13558): Terminating (SIGTERM) 13:57:31.003635 --- ParallelTerminationStrategy: PID 13552 died... 13:57:31.025911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13552): Terminated: ok {rc=0} 13:57:31.077887 --- ParallelTerminationStrategy: PID 13555 died... 13:57:31.098842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13555): Terminated: ok {rc=0} 13:57:31.151380 --- ParallelTerminationStrategy: PID 13558 died... 13:57:31.172221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13558): Terminated: ok {rc=0} 13:57:31.266111 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:57:32.357775 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:32.370407 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:57:32.424045 tst ping_idle_ping.py: using LAC 21932 13:57:32.552371 tst ping_idle_ping.py: using RAC 2 13:57:32.677639 tst ping_idle_ping.py: using CellId 21932 13:57:32.794097 tst ping_idle_ping.py: using BVCI 21933 13:57:32.902009 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:32.912872 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:32.923706 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:32.934550 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:32.945265 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:32.955964 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:32.966981 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:32.977741 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:57:33.096217 tst ping_idle_ping.py:24: start network... 13:57:33.310544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:57:33.779623 run create_hlr_db(pid=13560): Launched 13:57:33.904213 bus /gobi_6: Setting Powered False 13:57:34.968101 run create_hlr_db(pid=13560): Terminated: ok {rc=0} 13:57:35.394433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13562): Launched 13:57:35.690231 run osmo-hlr_10.42.42.2(pid=13563): Launched 13:57:35.804001 run osmo-stp_10.42.42.5: Starting osmo-stp 13:57:36.321294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13565): Launched 13:57:36.617419 run osmo-stp_10.42.42.5(pid=13566): Launched 13:57:36.729491 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:57:37.242934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13568): Launched 13:57:37.355948 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:57:37.606680 run patchelf(pid=13569): Launched 13:57:37.771343 run osmo-stp_10.42.42.5(pid=13566): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13566)] 13:57:37.896706 run osmo-stp_10.42.42.5(pid=13566): stdout: | (launched: 2022-12-09_13:57:36.562273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:38.024574 run osmo-stp_10.42.42.5(pid=13566): stderr: | 20221209135736732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135736732 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135736732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135736733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135736733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135736733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135736733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:38.151604 run osmo-stp_10.42.42.5(pid=13566): stdout: | (launched: 2022-12-09_13:57:36.562273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:38.272355 run osmo-stp_10.42.42.5(pid=13566): stderr: | 20221209135736732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135736732 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135736732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135736733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135736733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135736733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135736733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:38.415658 run patchelf(pid=13569): Terminating (SIGINT) 13:57:38.581913 run patchelf(pid=13569): Terminated: ok {rc=0} 13:57:38.701793 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13566): Process ended prematurely: osmo-stp_10.42.42.5(pid=13566) [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13566)] [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 13:57:38.710569 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 13:57:38.736937 run osmo-hlr_10.42.42.2(pid=13563): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13563)] 13:57:38.784196 run osmo-hlr_10.42.42.2(pid=13563): stdout: | (launched: 2022-12-09_13:57:35.635696) 13:57:38.833107 run osmo-hlr_10.42.42.2(pid=13563): stderr: | 20221209135735812 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135735812 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135735812 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135735812 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135735812 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135735812 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135735824 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135735838 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135735839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135735839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:57:38.882202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13562): Terminating (SIGTERM) 13:57:38.921717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13565): Terminating (SIGTERM) 13:57:38.961085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13568): Terminating (SIGTERM) 13:57:39.000641 --- ParallelTerminationStrategy: PID 13562 died... 13:57:39.019640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13562): Terminated: ok {rc=0} 13:57:39.063262 --- ParallelTerminationStrategy: PID 13565 died... 13:57:39.082015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13565): Terminated: ok {rc=0} 13:57:39.125388 --- ParallelTerminationStrategy: PID 13568 died... 13:57:39.143691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13568): Terminated: ok {rc=0} 13:57:39.226894 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:57:40.535281 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:57:40.542844 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:57:40.577285 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:57:40.616837 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:57:40.705256 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:57:40.738694 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:57:40.778356 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:57:41.369426 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:57:41.417855 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:41.429139 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:57:41.493710 tst cs_paging_gprs_active.py: using LAC 21933 13:57:41.620042 tst cs_paging_gprs_active.py: using RAC 3 13:57:41.747165 tst cs_paging_gprs_active.py: using CellId 21933 13:57:41.886257 tst cs_paging_gprs_active.py: using BVCI 21934 13:57:42.004062 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:42.015714 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:42.026899 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:42.038604 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:42.050217 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:42.061932 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:42.073519 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:42.084779 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:42.096445 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:57:42.212403 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:57:42.333347 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:57:42.552181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:42.876780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13573): Launched 13:57:43.158075 run iperf3-srv_10.42.42.10(pid=13574): Launched 13:57:43.279557 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:57:43.497740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:43.821650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13575): Launched 13:57:44.101722 run iperf3-srv_10.42.42.10(pid=13576): Launched 13:57:44.223203 tst cs_paging_gprs_active.py:38: start network... 13:57:44.441110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:57:44.941973 run create_hlr_db(pid=13577): Launched 13:57:45.064682 bus /gobi_6: Setting Powered False 13:57:46.127748 run create_hlr_db(pid=13577): Terminated: ok {rc=0} 13:57:46.583935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13579): Launched 13:57:46.922343 run osmo-hlr_10.42.42.2(pid=13580): Launched 13:57:47.062286 run osmo-stp_10.42.42.5: Starting osmo-stp 13:57:47.681464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13582): Launched 13:57:48.004172 run osmo-stp_10.42.42.5(pid=13583): Launched 13:57:48.127344 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:57:48.685495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13585): Launched 13:57:48.809066 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:57:49.082272 run patchelf(pid=13586): Launched 13:57:49.262521 run osmo-stp_10.42.42.5(pid=13583): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13583)] 13:57:49.399100 run osmo-stp_10.42.42.5(pid=13583): stdout: | (launched: 2022-12-09_13:57:47.945409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:49.537505 run osmo-stp_10.42.42.5(pid=13583): stderr: | 20221209135748137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135748137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135748137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135748138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135748138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135748138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135748138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:49.675764 run osmo-stp_10.42.42.5(pid=13583): stdout: | (launched: 2022-12-09_13:57:47.945409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:49.808315 run osmo-stp_10.42.42.5(pid=13583): stderr: | 20221209135748137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135748137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135748137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135748138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135748138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135748138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135748138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:49.965513 run patchelf(pid=13586): Terminating (SIGINT) 13:57:50.146458 run patchelf(pid=13586): Terminated: ok {rc=0} 13:57:50.276480 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13583): Process ended prematurely: osmo-stp_10.42.42.5(pid=13583) [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13583)] [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:57:50.286691 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:57:50.316210 run osmo-hlr_10.42.42.2(pid=13580): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13580)] 13:57:50.366205 run osmo-hlr_10.42.42.2(pid=13580): stdout: | (launched: 2022-12-09_13:57:46.861553) 13:57:50.418059 run osmo-hlr_10.42.42.2(pid=13580): stderr: | 20221209135747215 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135747215 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135747215 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135747215 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135747215 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135747215 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135747227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135747236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135747236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135747236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:57:50.470323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13573): Terminating (SIGTERM) 13:57:50.512389 run iperf3-srv_10.42.42.10(pid=13574): Terminating (SIGTERM) 13:57:50.554427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13575): Terminating (SIGTERM) 13:57:50.596362 run iperf3-srv_10.42.42.10(pid=13576): Terminating (SIGTERM) 13:57:50.638549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13579): Terminating (SIGTERM) 13:57:50.680477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13582): Terminating (SIGTERM) 13:57:50.722590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13585): Terminating (SIGTERM) 13:57:50.764787 --- ParallelTerminationStrategy: PID 13573 died... 13:57:50.784851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13573): Terminated: ok {rc=0} 13:57:50.831747 --- ParallelTerminationStrategy: PID 13574 died... 13:57:50.851317 run iperf3-srv_10.42.42.10(pid=13574): Terminated {rc=256} 13:57:50.897586 --- ParallelTerminationStrategy: PID 13575 died... 13:57:50.917114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13575): Terminated: ok {rc=0} 13:57:50.963271 --- ParallelTerminationStrategy: PID 13576 died... 13:57:50.982662 run iperf3-srv_10.42.42.10(pid=13576): Terminated {rc=256} 13:57:51.028649 --- ParallelTerminationStrategy: PID 13579 died... 13:57:51.048283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13579): Terminated: ok {rc=0} 13:57:51.094513 --- ParallelTerminationStrategy: PID 13582 died... 13:57:51.113997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13582): Terminated: ok {rc=0} 13:57:51.160416 --- ParallelTerminationStrategy: PID 13585 died... 13:57:51.179981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13585): Terminated: ok {rc=0} 13:57:51.267247 bus /gobi_0: Setting Powered False 13:57:52.368302 bus /gobi_0: Setting Powered False 13:57:53.484127 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:57:54.632771 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:54.644850 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:57:54.715704 tst iperf3.py: using LAC 21934 13:57:54.841634 tst iperf3.py: using RAC 4 13:57:54.963703 tst iperf3.py: using CellId 21934 13:57:55.084396 tst iperf3.py: using BVCI 21935 13:57:55.196736 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:55.207960 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:55.218889 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:55.230387 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:55.241859 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:55.253137 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:55.264394 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:55.275475 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:57:55.286809 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:57:55.402182 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:57:55.603986 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:55.906441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13587): Launched 13:57:56.169272 run iperf3-srv_10.42.42.10(pid=13588): Launched 13:57:56.282519 tst iperf3.py:8: start network... 13:57:56.483695 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:57:56.952421 run create_hlr_db(pid=13589): Launched 13:57:57.077253 bus /gobi_6: Setting Powered False 13:57:58.138707 run create_hlr_db(pid=13589): Terminated: ok {rc=0} 13:57:58.579117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13591): Launched 13:57:58.902814 run osmo-hlr_10.42.42.2(pid=13592): Launched 13:57:59.026476 run osmo-stp_10.42.42.5: Starting osmo-stp 13:57:59.582728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13594): Launched 13:57:59.905373 run osmo-stp_10.42.42.5(pid=13595): Launched 13:58:00.029065 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:58:00.586617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13597): Launched 13:58:00.710395 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:58:00.997767 run patchelf(pid=13598): Launched 13:58:01.187817 run osmo-stp_10.42.42.5(pid=13595): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13595)] 13:58:01.327966 run osmo-stp_10.42.42.5(pid=13595): stdout: | (launched: 2022-12-09_13:57:59.846568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:01.469802 run osmo-stp_10.42.42.5(pid=13595): stderr: | 20221209135800038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135800038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135800038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135800039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135800039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135800039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135800039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:01.613833 run osmo-stp_10.42.42.5(pid=13595): stdout: | (launched: 2022-12-09_13:57:59.846568) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:01.750090 run osmo-stp_10.42.42.5(pid=13595): stderr: | 20221209135800038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135800038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135800038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135800039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135800039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135800039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135800039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:01.911266 run patchelf(pid=13598): Terminating (SIGINT) 13:58:02.095385 run patchelf(pid=13598): Terminated: ok {rc=0} 13:58:02.228620 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13595): Process ended prematurely: osmo-stp_10.42.42.5(pid=13595) [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13595)] [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 13:58:02.239572 tst iperf3.py:8: Test FAILED (7.6 sec) 13:58:02.269444 run osmo-hlr_10.42.42.2(pid=13592): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13592)] 13:58:02.319999 run osmo-hlr_10.42.42.2(pid=13592): stdout: | (launched: 2022-12-09_13:57:58.843771) 13:58:02.372306 run osmo-hlr_10.42.42.2(pid=13592): stderr: | 20221209135759040 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135759040 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135759040 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135759040 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135759040 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135759040 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135759053 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135759061 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135759061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135759061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:58:02.425387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13587): Terminating (SIGTERM) 13:58:02.467430 run iperf3-srv_10.42.42.10(pid=13588): Terminating (SIGTERM) 13:58:02.509702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13591): Terminating (SIGTERM) 13:58:02.551893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13594): Terminating (SIGTERM) 13:58:02.594064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13597): Terminating (SIGTERM) 13:58:02.636479 --- ParallelTerminationStrategy: PID 13587 died... 13:58:02.656538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13587): Terminated: ok {rc=0} 13:58:02.703497 --- ParallelTerminationStrategy: PID 13588 died... 13:58:02.723139 run iperf3-srv_10.42.42.10(pid=13588): Terminated {rc=256} 13:58:02.769765 --- ParallelTerminationStrategy: PID 13591 died... 13:58:02.789519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13591): Terminated: ok {rc=0} 13:58:02.836366 --- ParallelTerminationStrategy: PID 13594 died... 13:58:02.856235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13594): Terminated: ok {rc=0} 13:58:02.903539 --- ParallelTerminationStrategy: PID 13597 died... 13:58:02.923338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13597): Terminated: ok {rc=0} 13:58:03.011693 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:58:04.161822 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:04.173980 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:58:04.243395 tst iperf3m4.py: using LAC 21935 13:58:04.370353 tst iperf3m4.py: using RAC 5 13:58:04.499840 tst iperf3m4.py: using CellId 21935 13:58:04.626728 tst iperf3m4.py: using BVCI 21936 13:58:04.746612 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:04.758032 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:04.769295 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:04.780830 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:04.792374 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:04.804028 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:04.815693 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:04.827548 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:04.839485 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:58:04.957254 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:58:05.079619 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:58:05.196225 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:58:05.315323 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:58:05.533233 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:05.857242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13599): Launched 13:58:06.138711 run iperf3-srv_10.42.42.10(pid=13600): Launched 13:58:06.261421 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:58:06.479616 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:06.803852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13601): Launched 13:58:07.084642 run iperf3-srv_10.42.42.10(pid=13602): Launched 13:58:07.206586 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:58:07.424018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:07.748192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13603): Launched 13:58:08.029733 run iperf3-srv_10.42.42.10(pid=13604): Launched 13:58:08.151356 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:58:08.368929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:08.693416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13605): Launched 13:58:08.974315 run iperf3-srv_10.42.42.10(pid=13606): Launched 13:58:09.095483 tst iperf3m4.py:8: start network... 13:58:09.313195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:58:09.813162 run create_hlr_db(pid=13607): Launched 13:58:09.935812 bus /gobi_6: Setting Powered False 13:58:10.998868 run create_hlr_db(pid=13607): Terminated: ok {rc=0} 13:58:11.447907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13609): Launched 13:58:11.770861 run osmo-hlr_10.42.42.2(pid=13610): Launched 13:58:11.894366 run osmo-stp_10.42.42.5: Starting osmo-stp 13:58:12.454319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13612): Launched 13:58:12.777672 run osmo-stp_10.42.42.5(pid=13613): Launched 13:58:12.901316 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:58:13.458243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13615): Launched 13:58:13.582419 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:58:13.855176 run patchelf(pid=13616): Launched 13:58:14.034823 run osmo-stp_10.42.42.5(pid=13613): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13613)] 13:58:14.172210 run osmo-stp_10.42.42.5(pid=13613): stdout: | (launched: 2022-12-09_13:58:12.718352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:14.311287 run osmo-stp_10.42.42.5(pid=13613): stderr: | 20221209135812906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135812906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135812906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135812907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135812907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135812907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135812907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:14.449924 run osmo-stp_10.42.42.5(pid=13613): stdout: | (launched: 2022-12-09_13:58:12.718352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:14.582898 run osmo-stp_10.42.42.5(pid=13613): stderr: | 20221209135812906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135812906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135812906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135812907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135812907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135812907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135812907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:14.739923 run patchelf(pid=13616): Terminating (SIGINT) 13:58:14.920365 run patchelf(pid=13616): Terminated: ok {rc=0} 13:58:15.050445 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13613): Process ended prematurely: osmo-stp_10.42.42.5(pid=13613) [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13613)] [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:58:15.060603 tst iperf3m4.py:8: Test FAILED (10.9 sec) 13:58:15.090155 run osmo-hlr_10.42.42.2(pid=13610): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13610)] 13:58:15.140554 run osmo-hlr_10.42.42.2(pid=13610): stdout: | (launched: 2022-12-09_13:58:11.711579) 13:58:15.192539 run osmo-hlr_10.42.42.2(pid=13610): stderr: | 20221209135811906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135811906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135811906 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135811906 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135811906 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135811906 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135811920 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135811928 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135811928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135811928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:58:15.244742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13599): Terminating (SIGTERM) 13:58:15.286682 run iperf3-srv_10.42.42.10(pid=13600): Terminating (SIGTERM) 13:58:15.328652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13601): Terminating (SIGTERM) 13:58:15.370514 run iperf3-srv_10.42.42.10(pid=13602): Terminating (SIGTERM) 13:58:15.412216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13603): Terminating (SIGTERM) 13:58:15.454121 run iperf3-srv_10.42.42.10(pid=13604): Terminating (SIGTERM) 13:58:15.495983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13605): Terminating (SIGTERM) 13:58:15.537855 run iperf3-srv_10.42.42.10(pid=13606): Terminating (SIGTERM) 13:58:15.579526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13609): Terminating (SIGTERM) 13:58:15.621259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13612): Terminating (SIGTERM) 13:58:15.663112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13615): Terminating (SIGTERM) 13:58:15.705792 --- ParallelTerminationStrategy: PID 13599 died... 13:58:15.725977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13599): Terminated: ok {rc=0} 13:58:15.773123 --- ParallelTerminationStrategy: PID 13600 died... 13:58:15.792677 run iperf3-srv_10.42.42.10(pid=13600): Terminated {rc=256} 13:58:15.839348 --- ParallelTerminationStrategy: PID 13601 died... 13:58:15.860001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13601): Terminated: ok {rc=0} 13:58:15.907725 --- ParallelTerminationStrategy: PID 13602 died... 13:58:15.927977 run iperf3-srv_10.42.42.10(pid=13602): Terminated {rc=256} 13:58:15.975351 --- ParallelTerminationStrategy: PID 13603 died... 13:58:15.995621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13603): Terminated: ok {rc=0} 13:58:16.043357 --- ParallelTerminationStrategy: PID 13604 died... 13:58:16.063699 run iperf3-srv_10.42.42.10(pid=13604): Terminated {rc=256} 13:58:16.111209 --- ParallelTerminationStrategy: PID 13605 died... 13:58:16.131416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13605): Terminated: ok {rc=0} 13:58:16.179476 --- ParallelTerminationStrategy: PID 13606 died... 13:58:16.199787 run iperf3-srv_10.42.42.10(pid=13606): Terminated {rc=256} 13:58:16.247127 --- ParallelTerminationStrategy: PID 13609 died... 13:58:16.267432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13609): Terminated: ok {rc=0} 13:58:16.314775 --- ParallelTerminationStrategy: PID 13612 died... 13:58:16.335026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13612): Terminated: ok {rc=0} 13:58:16.382839 --- ParallelTerminationStrategy: PID 13615 died... 13:58:16.403320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13615): Terminated: ok {rc=0} 13:58:16.493599 bus /gobi_4: Setting Powered False 13:58:17.591251 bus /gobi_4: Setting Powered False 13:58:18.708433 bus /gobi_1: Setting Powered False 13:58:19.807990 bus /gobi_1: Setting Powered False 13:58:20.925598 bus /gobi_0: Setting Powered False 13:58:22.023922 bus /gobi_0: Setting Powered False 13:58:23.140750 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:58:24.243884 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:24.255978 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:58:24.325120 tst ping.py: using LAC 21936 13:58:24.453420 tst ping.py: using RAC 6 13:58:24.570630 tst ping.py: using CellId 21936 13:58:24.688455 tst ping.py: using BVCI 21937 13:58:24.796900 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:24.808157 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:24.819206 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:24.830503 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:24.841606 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:24.852798 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:24.863854 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:24.874755 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:58:24.993277 tst ping.py:19: start network... 13:58:25.206824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:58:25.698117 run create_hlr_db(pid=13618): Launched 13:58:25.819833 bus /gobi_6: Setting Powered False 13:58:26.883409 run create_hlr_db(pid=13618): Terminated: ok {rc=0} 13:58:27.327396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13620): Launched 13:58:27.645149 run osmo-hlr_10.42.42.2(pid=13621): Launched 13:58:27.766935 run osmo-stp_10.42.42.5: Starting osmo-stp 13:58:28.319393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13623): Launched 13:58:28.637669 run osmo-stp_10.42.42.5(pid=13624): Launched 13:58:28.758864 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:58:29.308637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13626): Launched 13:58:29.430728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:58:29.698461 run patchelf(pid=13627): Launched 13:58:29.874912 run osmo-stp_10.42.42.5(pid=13624): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13624)] 13:58:30.009645 run osmo-stp_10.42.42.5(pid=13624): stdout: | (launched: 2022-12-09_13:58:28.579616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:30.146160 run osmo-stp_10.42.42.5(pid=13624): stderr: | 20221209135828770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135828770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135828770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135828771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135828771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135828771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135828771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:30.282756 run osmo-stp_10.42.42.5(pid=13624): stdout: | (launched: 2022-12-09_13:58:28.579616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:30.413427 run osmo-stp_10.42.42.5(pid=13624): stderr: | 20221209135828770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135828770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135828770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135828771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135828771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135828771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135828771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:30.567717 run patchelf(pid=13627): Terminating (SIGINT) 13:58:30.745608 run patchelf(pid=13627): Terminated: ok {rc=0} 13:58:30.878958 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13624): Process ended prematurely: osmo-stp_10.42.42.5(pid=13624) [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13624)] [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 13:58:30.889146 tst ping.py:22: Test FAILED (6.6 sec) 13:58:30.924489 run osmo-hlr_10.42.42.2(pid=13621): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13621)] 13:58:30.977643 run osmo-hlr_10.42.42.2(pid=13621): stdout: | (launched: 2022-12-09_13:58:27.587175) 13:58:31.031632 run osmo-hlr_10.42.42.2(pid=13621): stderr: | 20221209135827781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135827781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135827781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135827781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135827781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135827781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135827794 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135827804 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135827804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135827804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:58:31.085576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13620): Terminating (SIGTERM) 13:58:31.128924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13623): Terminating (SIGTERM) 13:58:31.172916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13626): Terminating (SIGTERM) 13:58:31.217225 --- ParallelTerminationStrategy: PID 13620 died... 13:58:31.237968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13620): Terminated: ok {rc=0} 13:58:31.286905 --- ParallelTerminationStrategy: PID 13623 died... 13:58:31.307596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13623): Terminated: ok {rc=0} 13:58:31.356373 --- ParallelTerminationStrategy: PID 13626 died... 13:58:31.377080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13626): Terminated: ok {rc=0} 13:58:31.467539 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:58:32.556417 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:32.569066 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:58:32.639318 tst ping_idle_ping.py: using LAC 21937 13:58:32.767147 tst ping_idle_ping.py: using RAC 7 13:58:32.891825 tst ping_idle_ping.py: using CellId 21937 13:58:33.014702 tst ping_idle_ping.py: using BVCI 21938 13:58:33.126162 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:33.137469 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:33.148310 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:33.159965 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:33.171438 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:33.183026 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:33.194680 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:33.206251 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:58:33.325545 tst ping_idle_ping.py:24: start network... 13:58:33.539920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:58:34.035987 run create_hlr_db(pid=13628): Launched 13:58:34.158716 bus /gobi_6: Setting Powered False 13:58:35.222297 run create_hlr_db(pid=13628): Terminated: ok {rc=0} 13:58:35.649049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13630): Launched 13:58:35.947929 run osmo-hlr_10.42.42.2(pid=13631): Launched 13:58:36.061305 run osmo-stp_10.42.42.5: Starting osmo-stp 13:58:36.573858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13633): Launched 13:58:36.871035 run osmo-stp_10.42.42.5(pid=13634): Launched 13:58:36.983666 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:58:37.495778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13636): Launched 13:58:37.608888 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:58:37.859993 run patchelf(pid=13637): Launched 13:58:38.025583 run osmo-stp_10.42.42.5(pid=13634): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13634)] 13:58:38.151442 run osmo-stp_10.42.42.5(pid=13634): stdout: | (launched: 2022-12-09_13:58:36.815898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:38.278831 run osmo-stp_10.42.42.5(pid=13634): stderr: | 20221209135836985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135836985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135836985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135836986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135836986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135836986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135836986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:38.406349 run osmo-stp_10.42.42.5(pid=13634): stdout: | (launched: 2022-12-09_13:58:36.815898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:38.529093 run osmo-stp_10.42.42.5(pid=13634): stderr: | 20221209135836985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135836985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135836985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135836986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135836986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135836986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135836986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:38.673353 run patchelf(pid=13637): Terminating (SIGINT) 13:58:38.839396 run patchelf(pid=13637): Terminated: ok {rc=0} 13:58:38.959178 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13634): Process ended prematurely: osmo-stp_10.42.42.5(pid=13634) [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13634)] [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:58:38.967984 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:58:38.994603 run osmo-hlr_10.42.42.2(pid=13631): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13631)] 13:58:39.041735 run osmo-hlr_10.42.42.2(pid=13631): stdout: | (launched: 2022-12-09_13:58:35.893321) 13:58:39.090635 run osmo-hlr_10.42.42.2(pid=13631): stderr: | 20221209135836068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135836068 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135836068 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135836068 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135836068 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135836068 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135836080 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135836089 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135836090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135836090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:58:39.140078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13630): Terminating (SIGTERM) 13:58:39.179565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13633): Terminating (SIGTERM) 13:58:39.219240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13636): Terminating (SIGTERM) 13:58:39.259144 --- ParallelTerminationStrategy: PID 13630 died... 13:58:39.278373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13630): Terminated: ok {rc=0} 13:58:39.322144 --- ParallelTerminationStrategy: PID 13633 died... 13:58:39.340801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13633): Terminated: ok {rc=0} 13:58:39.384791 --- ParallelTerminationStrategy: PID 13636 died... 13:58:39.403838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13636): Terminated: ok {rc=0} 13:58:39.489068 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:58:40.801267 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:58:40.808562 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:58:40.840654 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 13:58:40.878647 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 13:58:40.966511 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:58:40.997879 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 13:58:41.035289 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 13:58:41.634182 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 13:58:41.681776 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:41.693274 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:58:41.743086 tst cs_paging_gprs_active.py: using LAC 21938 13:58:41.861796 tst cs_paging_gprs_active.py: using RAC 8 13:58:41.983841 tst cs_paging_gprs_active.py: using CellId 21938 13:58:42.100698 tst cs_paging_gprs_active.py: using BVCI 21939 13:58:42.209123 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:42.220399 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:42.231475 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:42.242486 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:42.253471 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:42.264343 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:42.275436 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:42.286366 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:42.297598 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:58:42.415709 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:58:42.534386 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:58:42.749717 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:43.068183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13642): Launched 13:58:43.345018 run iperf3-srv_10.42.42.10(pid=13643): Launched 13:58:43.464438 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:58:43.678278 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:43.996665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13644): Launched 13:58:44.273071 run iperf3-srv_10.42.42.10(pid=13645): Launched 13:58:44.392427 tst cs_paging_gprs_active.py:38: start network... 13:58:44.606497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:58:45.100927 run create_hlr_db(pid=13646): Launched 13:58:45.223170 bus /gobi_6: Setting Powered False 13:58:46.304333 run create_hlr_db(pid=13646): Terminated: ok {rc=0} 13:58:46.816649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13648): Launched 13:58:47.140024 run osmo-hlr_10.42.42.2(pid=13649): Launched 13:58:47.368123 run osmo-stp_10.42.42.5: Starting osmo-stp 13:58:47.915305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13651): Launched 13:58:48.234624 run osmo-stp_10.42.42.5(pid=13652): Launched 13:58:48.356442 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:58:48.904776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13654): Launched 13:58:49.026851 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:58:49.296093 run patchelf(pid=13655): Launched 13:58:49.473519 run osmo-stp_10.42.42.5(pid=13652): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13652)] 13:58:49.608699 run osmo-stp_10.42.42.5(pid=13652): stdout: | (launched: 2022-12-09_13:58:48.176483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:49.745788 run osmo-stp_10.42.42.5(pid=13652): stderr: | 20221209135848367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135848367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135848367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135848367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135848368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135848368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135848368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:49.882570 run osmo-stp_10.42.42.5(pid=13652): stdout: | (launched: 2022-12-09_13:58:48.176483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:50.013796 run osmo-stp_10.42.42.5(pid=13652): stderr: | 20221209135848367 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135848367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135848367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135848367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135848368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135848368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135848368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:50.169577 run patchelf(pid=13655): Terminating (SIGINT) 13:58:50.347657 run patchelf(pid=13655): Terminated: ok {rc=0} 13:58:50.476488 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13652): Process ended prematurely: osmo-stp_10.42.42.5(pid=13652) [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13652)] [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 13:58:50.486761 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:58:50.515287 run osmo-hlr_10.42.42.2(pid=13649): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13649)] 13:58:50.566093 run osmo-hlr_10.42.42.2(pid=13649): stdout: | (launched: 2022-12-09_13:58:47.079346) 13:58:50.618195 run osmo-hlr_10.42.42.2(pid=13649): stderr: | 20221209135847308 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135847308 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135847308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135847308 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135847308 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135847308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135847328 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135847336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135847337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135847337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:58:50.670477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13642): Terminating (SIGTERM) 13:58:50.712541 run iperf3-srv_10.42.42.10(pid=13643): Terminating (SIGTERM) 13:58:50.754539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13644): Terminating (SIGTERM) 13:58:50.796665 run iperf3-srv_10.42.42.10(pid=13645): Terminating (SIGTERM) 13:58:50.838654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13648): Terminating (SIGTERM) 13:58:50.880701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13651): Terminating (SIGTERM) 13:58:50.922815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13654): Terminating (SIGTERM) 13:58:50.965082 --- ParallelTerminationStrategy: PID 13642 died... 13:58:50.985122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13642): Terminated: ok {rc=0} 13:58:51.032403 --- ParallelTerminationStrategy: PID 13643 died... 13:58:51.051968 run iperf3-srv_10.42.42.10(pid=13643): Terminated {rc=256} 13:58:51.098610 --- ParallelTerminationStrategy: PID 13644 died... 13:58:51.118150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13644): Terminated: ok {rc=0} 13:58:51.164881 --- ParallelTerminationStrategy: PID 13645 died... 13:58:51.184715 run iperf3-srv_10.42.42.10(pid=13645): Terminated {rc=256} 13:58:51.231403 --- ParallelTerminationStrategy: PID 13648 died... 13:58:51.251028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13648): Terminated: ok {rc=0} 13:58:51.297342 --- ParallelTerminationStrategy: PID 13651 died... 13:58:51.317050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13651): Terminated: ok {rc=0} 13:58:51.363470 --- ParallelTerminationStrategy: PID 13654 died... 13:58:51.383072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13654): Terminated: ok {rc=0} 13:58:51.470127 bus /gobi_0: Setting Powered False 13:58:52.569997 bus /gobi_0: Setting Powered False 13:58:53.689597 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 13:58:54.835224 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:54.847566 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:58:54.897419 tst iperf3.py: using LAC 21939 13:58:55.016216 tst iperf3.py: using RAC 9 13:58:55.146521 tst iperf3.py: using CellId 21939 13:58:55.271901 tst iperf3.py: using BVCI 21940 13:58:55.390894 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:55.402970 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:55.414796 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:55.427229 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:55.439632 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:55.451733 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:55.464570 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:55.477016 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:58:55.490468 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:58:55.609203 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:58:55.809118 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:56.109646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13657): Launched 13:58:56.369552 run iperf3-srv_10.42.42.10(pid=13658): Launched 13:58:56.480820 tst iperf3.py:8: start network... 13:58:56.680701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:58:57.142939 run create_hlr_db(pid=13659): Launched 13:58:57.265887 bus /gobi_6: Setting Powered False 13:58:58.325727 run create_hlr_db(pid=13659): Terminated: ok {rc=0} 13:58:58.742141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13661): Launched 13:58:59.040444 run osmo-hlr_10.42.42.2(pid=13662): Launched 13:58:59.154800 run osmo-stp_10.42.42.5: Starting osmo-stp 13:58:59.685315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13664): Launched 13:58:59.983522 run osmo-stp_10.42.42.5(pid=13665): Launched 13:59:00.097829 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:59:00.615127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13667): Launched 13:59:00.729597 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:59:01.001397 run patchelf(pid=13668): Launched 13:59:01.182939 run osmo-stp_10.42.42.5(pid=13665): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13665)] 13:59:01.312704 run osmo-stp_10.42.42.5(pid=13665): stdout: | (launched: 2022-12-09_13:58:59.928632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:01.443271 run osmo-stp_10.42.42.5(pid=13665): stderr: | 20221209135900099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135900099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135900099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135900099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135900100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135900100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135900100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:01.574794 run osmo-stp_10.42.42.5(pid=13665): stdout: | (launched: 2022-12-09_13:58:59.928632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:01.700292 run osmo-stp_10.42.42.5(pid=13665): stderr: | 20221209135900099 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135900099 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135900099 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135900099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135900100 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135900100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135900100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:01.849193 run patchelf(pid=13668): Terminating (SIGINT) 13:59:02.019792 run patchelf(pid=13668): Terminated: ok {rc=0} 13:59:02.143637 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13665): Process ended prematurely: osmo-stp_10.42.42.5(pid=13665) [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13665)] [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 13:59:02.153891 tst iperf3.py:8: Test FAILED (7.4 sec) 13:59:02.181695 run osmo-hlr_10.42.42.2(pid=13662): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13662)] 13:59:02.230717 run osmo-hlr_10.42.42.2(pid=13662): stdout: | (launched: 2022-12-09_13:58:58.985595) 13:59:02.279830 run osmo-hlr_10.42.42.2(pid=13662): stderr: | 20221209135859160 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135859161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135859161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135859161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135859161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135859161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135859173 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135859182 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135859182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135859182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:02.329638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13657): Terminating (SIGTERM) 13:59:02.369169 run iperf3-srv_10.42.42.10(pid=13658): Terminating (SIGTERM) 13:59:02.408784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13661): Terminating (SIGTERM) 13:59:02.448608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13664): Terminating (SIGTERM) 13:59:02.488089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13667): Terminating (SIGTERM) 13:59:02.527657 --- ParallelTerminationStrategy: PID 13657 died... 13:59:02.546691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13657): Terminated: ok {rc=0} 13:59:02.590689 --- ParallelTerminationStrategy: PID 13658 died... 13:59:02.609562 run iperf3-srv_10.42.42.10(pid=13658): Terminated {rc=256} 13:59:02.653185 --- ParallelTerminationStrategy: PID 13661 died... 13:59:02.671688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13661): Terminated: ok {rc=0} 13:59:02.715563 --- ParallelTerminationStrategy: PID 13664 died... 13:59:02.734120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13664): Terminated: ok {rc=0} 13:59:02.778274 --- ParallelTerminationStrategy: PID 13667 died... 13:59:02.796875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13667): Terminated: ok {rc=0} 13:59:02.878464 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 13:59:04.026105 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:04.038651 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:59:04.092889 tst iperf3m4.py: using LAC 21940 13:59:04.217721 tst iperf3m4.py: using RAC 10 13:59:04.344156 tst iperf3m4.py: using CellId 21940 13:59:04.473611 tst iperf3m4.py: using BVCI 21941 13:59:04.583896 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:04.595474 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:04.606911 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:04.618794 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:04.630246 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:04.641556 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:04.652659 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:04.663759 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:04.675033 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:59:04.791929 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:59:04.908920 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:59:05.027654 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:59:05.145876 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:59:05.363444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:59:05.684649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13669): Launched 13:59:05.962778 run iperf3-srv_10.42.42.10(pid=13670): Launched 13:59:06.083160 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:59:06.298692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:59:06.620119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13671): Launched 13:59:06.898289 run iperf3-srv_10.42.42.10(pid=13672): Launched 13:59:07.018015 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:59:07.233925 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:59:07.555258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13673): Launched 13:59:07.834130 run iperf3-srv_10.42.42.10(pid=13674): Launched 13:59:07.954288 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:59:08.169551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:59:08.490570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13675): Launched 13:59:08.769425 run iperf3-srv_10.42.42.10(pid=13676): Launched 13:59:08.889667 tst iperf3m4.py:8: start network... 13:59:09.105076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:09.601726 run create_hlr_db(pid=13677): Launched 13:59:09.723174 bus /gobi_6: Setting Powered False 13:59:10.786084 run create_hlr_db(pid=13677): Terminated: ok {rc=0} 13:59:11.213495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13679): Launched 13:59:11.513367 run osmo-hlr_10.42.42.2(pid=13680): Launched 13:59:11.628032 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:12.147876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13682): Launched 13:59:12.448401 run osmo-stp_10.42.42.5(pid=13683): Launched 13:59:12.563276 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:59:13.081725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13685): Launched 13:59:13.196330 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:59:13.449844 run patchelf(pid=13686): Launched 13:59:13.616326 run osmo-stp_10.42.42.5(pid=13683): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13683)] 13:59:13.743289 run osmo-stp_10.42.42.5(pid=13683): stdout: | (launched: 2022-12-09_13:59:12.392871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:13.871995 run osmo-stp_10.42.42.5(pid=13683): stderr: | 20221209135912557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135912557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135912557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135912558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135912558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135912558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135912558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:14.000692 run osmo-stp_10.42.42.5(pid=13683): stdout: | (launched: 2022-12-09_13:59:12.392871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:14.124038 run osmo-stp_10.42.42.5(pid=13683): stderr: | 20221209135912557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135912557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135912557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135912558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135912558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135912558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135912558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:14.270097 run patchelf(pid=13686): Terminating (SIGINT) 13:59:14.438176 run patchelf(pid=13686): Terminated: ok {rc=0} 13:59:14.559698 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13683): Process ended prematurely: osmo-stp_10.42.42.5(pid=13683) [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13683)] [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 13:59:14.569506 tst iperf3m4.py:8: Test FAILED (10.6 sec) 13:59:14.597134 run osmo-hlr_10.42.42.2(pid=13680): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13680)] 13:59:14.644423 run osmo-hlr_10.42.42.2(pid=13680): stdout: | (launched: 2022-12-09_13:59:11.458522) 13:59:14.693774 run osmo-hlr_10.42.42.2(pid=13680): stderr: | 20221209135911632 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135911632 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135911632 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135911632 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135911632 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135911632 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135911644 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135911653 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135911653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135911654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:14.744140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13669): Terminating (SIGTERM) 13:59:14.784001 run iperf3-srv_10.42.42.10(pid=13670): Terminating (SIGTERM) 13:59:14.823696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13671): Terminating (SIGTERM) 13:59:14.863387 run iperf3-srv_10.42.42.10(pid=13672): Terminating (SIGTERM) 13:59:14.903145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13673): Terminating (SIGTERM) 13:59:14.943051 run iperf3-srv_10.42.42.10(pid=13674): Terminating (SIGTERM) 13:59:14.982612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13675): Terminating (SIGTERM) 13:59:15.022292 run iperf3-srv_10.42.42.10(pid=13676): Terminating (SIGTERM) 13:59:15.061886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13679): Terminating (SIGTERM) 13:59:15.101620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13682): Terminating (SIGTERM) 13:59:15.141355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13685): Terminating (SIGTERM) 13:59:15.181904 --- ParallelTerminationStrategy: PID 13669 died... 13:59:15.200997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13669): Terminated: ok {rc=0} 13:59:15.245167 --- ParallelTerminationStrategy: PID 13670 died... 13:59:15.263735 run iperf3-srv_10.42.42.10(pid=13670): Terminated {rc=256} 13:59:15.307801 --- ParallelTerminationStrategy: PID 13671 died... 13:59:15.326703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13671): Terminated: ok {rc=0} 13:59:15.370889 --- ParallelTerminationStrategy: PID 13672 died... 13:59:15.389640 run iperf3-srv_10.42.42.10(pid=13672): Terminated {rc=256} 13:59:15.433459 --- ParallelTerminationStrategy: PID 13673 died... 13:59:15.452021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13673): Terminated: ok {rc=0} 13:59:15.495789 --- ParallelTerminationStrategy: PID 13674 died... 13:59:15.514433 run iperf3-srv_10.42.42.10(pid=13674): Terminated {rc=256} 13:59:15.557909 --- ParallelTerminationStrategy: PID 13675 died... 13:59:15.576800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13675): Terminated: ok {rc=0} 13:59:15.620645 --- ParallelTerminationStrategy: PID 13676 died... 13:59:15.639224 run iperf3-srv_10.42.42.10(pid=13676): Terminated {rc=256} 13:59:15.682781 --- ParallelTerminationStrategy: PID 13679 died... 13:59:15.701476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13679): Terminated: ok {rc=0} 13:59:15.745139 --- ParallelTerminationStrategy: PID 13682 died... 13:59:15.763720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13682): Terminated: ok {rc=0} 13:59:15.807569 --- ParallelTerminationStrategy: PID 13685 died... 13:59:15.826297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13685): Terminated: ok {rc=0} 13:59:15.914834 bus /gobi_4: Setting Powered False 13:59:17.019868 bus /gobi_4: Setting Powered False 13:59:18.137924 bus /gobi_1: Setting Powered False 13:59:19.236668 bus /gobi_1: Setting Powered False 13:59:20.351871 bus /gobi_0: Setting Powered False 13:59:21.450713 bus /gobi_0: Setting Powered False 13:59:22.566639 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 13:59:23.670534 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:23.682729 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:59:23.733292 tst ping.py: using LAC 21941 13:59:23.850519 tst ping.py: using RAC 11 13:59:23.967792 tst ping.py: using CellId 21941 13:59:24.084811 tst ping.py: using BVCI 21942 13:59:24.191653 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:24.203197 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:24.214513 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:24.225825 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:24.237142 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:24.248472 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:24.259856 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:24.271195 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:59:24.384795 tst ping.py:19: start network... 13:59:24.580231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:25.036458 run create_hlr_db(pid=13687): Launched 13:59:25.156819 bus /gobi_6: Setting Powered False 13:59:26.219096 run create_hlr_db(pid=13687): Terminated: ok {rc=0} 13:59:26.641395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13689): Launched 13:59:26.937723 run osmo-hlr_10.42.42.2(pid=13690): Launched 13:59:27.048857 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:27.553726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13692): Launched 13:59:27.846994 run osmo-stp_10.42.42.5(pid=13693): Launched 13:59:27.957813 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:59:28.481276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13695): Launched 13:59:28.593864 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:59:28.841904 run patchelf(pid=13696): Launched 13:59:29.005469 run osmo-stp_10.42.42.5(pid=13693): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13693)] 13:59:29.129991 run osmo-stp_10.42.42.5(pid=13693): stdout: | (launched: 2022-12-09_13:59:27.792748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:29.256076 run osmo-stp_10.42.42.5(pid=13693): stderr: | 20221209135927960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135927961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135927961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135927961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135927962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135927962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135927962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:29.382309 run osmo-stp_10.42.42.5(pid=13693): stdout: | (launched: 2022-12-09_13:59:27.792748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:29.503081 run osmo-stp_10.42.42.5(pid=13693): stderr: | 20221209135927960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135927961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135927961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135927961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135927962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135927962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135927962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:29.645908 run patchelf(pid=13696): Terminating (SIGINT) 13:59:29.810621 run patchelf(pid=13696): Terminated: ok {rc=0} 13:59:29.929585 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13693): Process ended prematurely: osmo-stp_10.42.42.5(pid=13693) [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13693)] [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 13:59:29.938582 tst ping.py:22: Test FAILED (6.3 sec) 13:59:29.965094 run osmo-hlr_10.42.42.2(pid=13690): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13690)] 13:59:30.012036 run osmo-hlr_10.42.42.2(pid=13690): stdout: | (launched: 2022-12-09_13:59:26.883462) 13:59:30.060846 run osmo-hlr_10.42.42.2(pid=13690): stderr: | 20221209135927059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135927059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135927059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135927059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135927059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135927059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135927071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135927080 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135927080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135927080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:30.110448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13689): Terminating (SIGTERM) 13:59:30.150124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13692): Terminating (SIGTERM) 13:59:30.189761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13695): Terminating (SIGTERM) 13:59:30.229419 --- ParallelTerminationStrategy: PID 13689 died... 13:59:30.247965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13689): Terminated: ok {rc=0} 13:59:30.291840 --- ParallelTerminationStrategy: PID 13692 died... 13:59:30.310425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13692): Terminated: ok {rc=0} 13:59:30.354096 --- ParallelTerminationStrategy: PID 13695 died... 13:59:30.372810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13695): Terminated: ok {rc=0} 13:59:30.457358 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 13:59:31.550549 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:31.563867 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:59:31.618254 tst ping_idle_ping.py: using LAC 21942 13:59:31.745725 tst ping_idle_ping.py: using RAC 12 13:59:31.870564 tst ping_idle_ping.py: using CellId 21942 13:59:31.995444 tst ping_idle_ping.py: using BVCI 21943 13:59:32.115048 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:32.128148 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:32.141679 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:32.155106 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:32.167901 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:32.182039 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:32.195893 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:59:32.208748 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:59:32.335079 tst ping_idle_ping.py:24: start network... 13:59:32.547378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:33.037738 run create_hlr_db(pid=13697): Launched 13:59:33.157071 bus /gobi_6: Setting Powered False 13:59:34.219955 run create_hlr_db(pid=13697): Terminated: ok {rc=0} 13:59:34.658540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13699): Launched 13:59:34.973490 run osmo-hlr_10.42.42.2(pid=13700): Launched 13:59:35.094426 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:35.636061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13702): Launched 13:59:35.951054 run osmo-stp_10.42.42.5(pid=13703): Launched 13:59:36.071243 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:59:36.614204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13705): Launched 13:59:36.734496 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:59:37.000147 run patchelf(pid=13706): Launched 13:59:37.175676 run osmo-stp_10.42.42.5(pid=13703): ERR: Terminated: ERROR {rc=1} [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13703)] 13:59:37.310162 run osmo-stp_10.42.42.5(pid=13703): stdout: | (launched: 2022-12-09_13:59:35.893852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:37.445802 run osmo-stp_10.42.42.5(pid=13703): stderr: | 20221209135936083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135936084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135936084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135936084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135936085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135936085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135936085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:37.581642 run osmo-stp_10.42.42.5(pid=13703): stdout: | (launched: 2022-12-09_13:59:35.893852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:37.711597 run osmo-stp_10.42.42.5(pid=13703): stderr: | 20221209135936083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135936084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135936084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135936084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135936085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135936085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135936085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:37.865541 run patchelf(pid=13706): Terminating (SIGINT) 13:59:38.041793 run patchelf(pid=13706): Terminated: ok {rc=0} 13:59:38.169016 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13703): Process ended prematurely: osmo-stp_10.42.42.5(pid=13703) [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13703)] [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 13:59:38.179209 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:59:38.207747 run osmo-hlr_10.42.42.2(pid=13700): ERR: Terminated: ERROR {rc=237} [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13700)] 13:59:38.258199 run osmo-hlr_10.42.42.2(pid=13700): stdout: | (launched: 2022-12-09_13:59:34.915967) 13:59:38.310392 run osmo-hlr_10.42.42.2(pid=13700): stderr: | 20221209135935112 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135935112 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135935112 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135935112 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135935112 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135935112 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135935125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135935133 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135935133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135935133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:38.363079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13699): Terminating (SIGTERM) 13:59:38.405386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13702): Terminating (SIGTERM) 13:59:38.447650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13705): Terminating (SIGTERM) 13:59:38.489879 --- ParallelTerminationStrategy: PID 13699 died... 13:59:38.509862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13699): Terminated: ok {rc=0} 13:59:38.556553 --- ParallelTerminationStrategy: PID 13702 died... 13:59:38.576181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13702): Terminated: ok {rc=0} 13:59:38.622367 --- ParallelTerminationStrategy: PID 13705 died... 13:59:38.641978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13705): Terminated: ok {rc=0} 13:59:38.730360 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 13:59:40.047657 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:59:40.055087 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:59:40.088386 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:59:40.123089 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:59:40.176149 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:59:40.208376 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:59:40.242825 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:59:40.804047 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2360 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:59:40.809367 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:59:40.821014 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:59:40.888517 tst switch_tch_pdch.py: using LAC 21943 13:59:41.006756 tst switch_tch_pdch.py: using RAC 13 13:59:41.122545 tst switch_tch_pdch.py: using CellId 21943 13:59:41.239697 tst switch_tch_pdch.py: using BVCI 21944 13:59:41.347454 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:59:41.359017 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:59:41.370332 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:59:41.381715 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:59:41.392824 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:59:41.403980 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:59:41.415358 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:59:41.426713 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:59:41.543680 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:59:41.663189 tst switch_tch_pdch.py:51: start network... 13:59:41.874136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:42.361037 run create_hlr_db(pid=13710): Launched 13:59:42.481481 bus /gobi_6: Setting Powered False 13:59:43.540455 run create_hlr_db(pid=13710): Terminated: ok {rc=0} 13:59:43.958704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13712): Launched 13:59:44.251377 run osmo-hlr_10.42.42.2(pid=13713): Launched 13:59:44.362879 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:44.867584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13715): Launched 13:59:45.161661 run osmo-stp_10.42.42.5(pid=13716): Launched 13:59:45.274447 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:59:45.781440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13718): Launched 13:59:45.913981 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:59:46.189050 run patchelf(pid=13719): Launched 13:59:46.414287 run osmo-stp_10.42.42.5(pid=13716): ERR: Terminated: ERROR {rc=1} [trial-2360↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13716)] 13:59:46.581655 run osmo-stp_10.42.42.5(pid=13716): stdout: | (launched: 2022-12-09_13:59:45.107832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:46.722839 run osmo-stp_10.42.42.5(pid=13716): stderr: | 20221209135945276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135945276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135945276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135945276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135945277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135945277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135945277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:46.863851 run osmo-stp_10.42.42.5(pid=13716): stdout: | (launched: 2022-12-09_13:59:45.107832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:46.997420 run osmo-stp_10.42.42.5(pid=13716): stderr: | 20221209135945276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209135945276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209135945276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209135945276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209135945277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209135945277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209135945277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:47.156403 run patchelf(pid=13719): Terminating (SIGINT) 13:59:47.338236 run patchelf(pid=13719): Terminated: ok {rc=0} 13:59:47.465732 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13716): Process ended prematurely: osmo-stp_10.42.42.5(pid=13716) [trial-2360↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13716)] [trial-2360↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:59:47.475572 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 13:59:47.504844 run osmo-hlr_10.42.42.2(pid=13713): ERR: Terminated: ERROR {rc=237} [trial-2360↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13713)] 13:59:47.555877 run osmo-hlr_10.42.42.2(pid=13713): stdout: | (launched: 2022-12-09_13:59:44.197539) 13:59:47.609265 run osmo-hlr_10.42.42.2(pid=13713): stderr: | 20221209135944371 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209135944371 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209135944371 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209135944372 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209135944372 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209135944372 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209135944383 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209135944392 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209135944392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209135944392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:47.662634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13712): Terminating (SIGTERM) 13:59:47.705488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13715): Terminating (SIGTERM) 13:59:47.748272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13718): Terminating (SIGTERM) 13:59:47.791504 --- ParallelTerminationStrategy: PID 13712 died... 13:59:47.811692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13712): Terminated: ok {rc=0} 13:59:47.858917 --- ParallelTerminationStrategy: PID 13715 died... 13:59:47.878651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13715): Terminated: ok {rc=0} 13:59:47.925602 --- ParallelTerminationStrategy: PID 13718 died... 13:59:47.945318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13718): Terminated: ok {rc=0} 13:59:48.033370 bus /gobi_0: Setting Powered False 13:59:49.132222 bus /gobi_0: Setting Powered False 13:59:50.249678 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2360 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 nitb_smpp --------------------------------------------------------------------- 13:59:51.506099 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:59:51.509068 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 13:59:51.530237 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 13:59:51.537230 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 13:59:51.573998 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 13:59:51.594376 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 13:59:51.601096 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 13:59:52.126361 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2360 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 13:59:52.132927 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 13:59:52.158673 tst esme_connect_policy_acceptall.py: using MSISDN 7240 13:59:52.300862 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:59:52.899823 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13723): Launched 13:59:53.221460 run osmo-nitb_10.42.42.2(pid=13724): Launched 13:59:53.399558 run osmo-nitb_10.42.42.2(pid=13724): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13724)] 13:59:53.543689 run osmo-nitb_10.42.42.2(pid=13724): stdout: | (launched: 2022-12-09_13:59:53.163046) 13:59:53.689629 run osmo-nitb_10.42.42.2(pid=13724): stderr: | (launched: 2022-12-09_13:59:53.211256) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:59:53.835525 run osmo-nitb_10.42.42.2(pid=13724): stdout: | (launched: 2022-12-09_13:59:53.163046) 13:59:53.975640 run osmo-nitb_10.42.42.2(pid=13724): stderr: | (launched: 2022-12-09_13:59:53.211256) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13724): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13724) [trial-2360↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13724)] 13:59:54.342715 tst osmo-nitb_10.42.42.2(pid=13724): stdout: | (launched: 2022-12-09_13:59:53.163046) 13:59:54.472873 tst osmo-nitb_10.42.42.2(pid=13724): stderr: | (launched: 2022-12-09_13:59:53.211256) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:59:54.626229 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=13724): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13724) [trial-2360↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13724)] [trial-2360↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 13:59:54.635029 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 13:59:54.641919 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13723): Terminating (SIGTERM) 13:59:54.853415 --- ParallelTerminationStrategy: PID 13723 died... 13:59:54.874623 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13723): Terminated: ok {rc=0} ---------------------------------------------- trial-2360 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 13:59:54.926064 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 13:59:54.953809 tst esme_connect_policy_closed.py: using MSISDN 7241 13:59:55.081877 tst esme_connect_policy_closed.py: using MSISDN 7242 13:59:55.198902 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:59:55.797043 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13725): Launched 13:59:56.119797 run osmo-nitb_10.42.42.2(pid=13726): Launched 13:59:56.294097 run osmo-nitb_10.42.42.2(pid=13726): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13726)] 13:59:56.427473 run osmo-nitb_10.42.42.2(pid=13726): stdout: | (launched: 2022-12-09_13:59:56.060822) 13:59:56.562964 run osmo-nitb_10.42.42.2(pid=13726): stderr: | (launched: 2022-12-09_13:59:56.109283) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:59:56.697777 run osmo-nitb_10.42.42.2(pid=13726): stdout: | (launched: 2022-12-09_13:59:56.060822) 13:59:56.826455 run osmo-nitb_10.42.42.2(pid=13726): stderr: | (launched: 2022-12-09_13:59:56.109283) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:59:56.980170 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=13726): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13726) [trial-2360↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13726)] [trial-2360↪nitb_smpp↪esme_connect_policy_closed.py:24] 13:59:56.989201 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 13:59:56.996040 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13725): Terminating (SIGTERM) 13:59:57.207314 --- ParallelTerminationStrategy: PID 13725 died... 13:59:57.228012 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13725): Terminated: ok {rc=0} ---------------------------------------------- trial-2360 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 13:59:57.279203 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 13:59:57.290826 tst nitb_smpp: Using 1 x bts (candidates: 1) 13:59:57.327621 tst esme_ms_sms_storeforward.py: using LAC 21944 13:59:57.457924 tst esme_ms_sms_storeforward.py: using RAC 14 13:59:57.586039 tst esme_ms_sms_storeforward.py: using CellId 21944 13:59:57.716834 tst esme_ms_sms_storeforward.py: using BVCI 21945 13:59:57.836594 tst nitb_smpp: Using 1 x modem (candidates: 1) 13:59:57.961147 tst esme_ms_sms_storeforward.py: using MSISDN 7243 13:59:58.070893 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 13:59:58.274625 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:59:58.892832 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13727): Launched 13:59:59.196605 run osmo-nitb_10.42.42.2(pid=13728): Launched 13:59:59.360132 run osmo-nitb_10.42.42.2(pid=13728): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13728)] 13:59:59.484799 run osmo-nitb_10.42.42.2(pid=13728): stdout: | (launched: 2022-12-09_13:59:59.141450) 13:59:59.611945 run osmo-nitb_10.42.42.2(pid=13728): stderr: | (launched: 2022-12-09_13:59:59.186757) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:59:59.738487 run osmo-nitb_10.42.42.2(pid=13728): stdout: | (launched: 2022-12-09_13:59:59.141450) 13:59:59.858883 run osmo-nitb_10.42.42.2(pid=13728): stderr: | (launched: 2022-12-09_13:59:59.186757) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:00:00.002964 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=13728): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13728) [trial-2360↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13728)] [trial-2360↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 14:00:00.011275 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.7 sec) 14:00:00.017962 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13727): Terminating (SIGTERM) 14:00:00.226012 --- ParallelTerminationStrategy: PID 13727 died... 14:00:00.246694 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13727): Terminated: ok {rc=0} 14:00:00.331566 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 14:00:01.419276 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 14:00:01.431450 tst nitb_smpp: Using 1 x bts (candidates: 1) 14:00:01.467686 tst esme_ms_sms_transaction.py: using LAC 21945 14:00:01.607298 tst esme_ms_sms_transaction.py: using RAC 15 14:00:01.768101 tst esme_ms_sms_transaction.py: using CellId 21945 14:00:01.932282 tst esme_ms_sms_transaction.py: using BVCI 21946 14:00:02.085780 tst nitb_smpp: Using 1 x modem (candidates: 1) 14:00:02.242285 tst esme_ms_sms_transaction.py: using MSISDN 7244 14:00:02.419356 tst esme_ms_sms_transaction.py:18: start nitb and bts... 14:00:02.636502 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:00:03.256119 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13739): Launched 14:00:03.558246 run osmo-nitb_10.42.42.2(pid=13740): Launched 14:00:03.725515 run osmo-nitb_10.42.42.2(pid=13740): ERR: Terminated: ERROR {rc=2} [trial-2360↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13740)] 14:00:03.860663 run osmo-nitb_10.42.42.2(pid=13740): stdout: | (launched: 2022-12-09_14:00:03.503286) 14:00:03.997692 run osmo-nitb_10.42.42.2(pid=13740): stderr: | (launched: 2022-12-09_14:00:03.548241) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:00:04.134823 run osmo-nitb_10.42.42.2(pid=13740): stdout: | (launched: 2022-12-09_14:00:03.503286) 14:00:04.266286 run osmo-nitb_10.42.42.2(pid=13740): stderr: | (launched: 2022-12-09_14:00:03.548241) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fbacfce4268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13740): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13740) [trial-2360↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13740)] 14:00:04.672555 tst osmo-nitb_10.42.42.2(pid=13740): stdout: | (launched: 2022-12-09_14:00:03.503286) 14:00:04.795523 tst osmo-nitb_10.42.42.2(pid=13740): stderr: | (launched: 2022-12-09_14:00:03.548241) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:00:04.939242 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=13740): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13740) [trial-2360↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13740)] [trial-2360↪nitb_smpp↪esme_ms_sms_transaction.py:21] 14:00:04.947594 tst esme_ms_sms_transaction.py:21: Test FAILED (3.5 sec) 14:00:04.954032 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13739): Terminating (SIGTERM) 14:00:05.162493 --- ParallelTerminationStrategy: PID 13739 died... 14:00:05.183355 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13739): Terminated: ok {rc=0} 14:00:05.268199 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 smpp --------------------------------------------------------------------- 14:00:06.440060 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:00:06.443116 tst smpp: Verifying 1 x bts (candidates: 11) 14:00:06.465277 tst smpp: Verifying 6 x ip_address (candidates: 9) 14:00:06.493382 tst smpp: Verifying 1 x modem (candidates: 12) 14:00:06.531180 tst smpp: Reserving 1 x bts (candidates: 11) 14:00:06.551979 tst smpp: Reserving 6 x ip_address (candidates: 9) 14:00:06.578262 tst smpp: Reserving 1 x modem (candidates: 12) 14:00:07.103839 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2360 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 14:00:07.108939 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:07.119807 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:07.130387 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:07.140853 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:07.159948 tst esme_connect_policy_acceptall.py: using MSISDN 7245 14:00:07.272584 run osmo-stp_10.42.42.4: Starting osmo-stp 14:00:07.789866 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13744): Launched 14:00:08.092111 run osmo-stp_10.42.42.4(pid=13745): Launched 14:00:08.207471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:08.675225 run create_hlr_db(pid=13746): Launched 14:00:08.799171 bus /sierra_2: Setting Powered False 14:00:09.858931 run create_hlr_db(pid=13746): Terminated: ok {rc=0} 14:00:10.281258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13748): Launched 14:00:10.583863 run osmo-hlr_10.42.42.2(pid=13749): Launched 14:00:10.698867 run osmo-msc_10.42.42.5: Starting osmo-msc 14:00:11.248225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13751): Launched 14:00:11.553250 run osmo-msc_10.42.42.5(pid=13752): Launched 14:00:11.723606 run osmo-hlr_10.42.42.2(pid=13749): ERR: Terminated: ERROR {rc=237} [trial-2360↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13749)] 14:00:11.853751 run osmo-hlr_10.42.42.2(pid=13749): stdout: | (launched: 2022-12-09_14:00:10.528462) 14:00:11.983434 run osmo-hlr_10.42.42.2(pid=13749): stderr: | 20221209140010702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140010702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140010702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140010702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140010702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140010703 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140010716 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140010725 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140010725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140010725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:12.110244 run osmo-hlr_10.42.42.2(pid=13749): stdout: | (launched: 2022-12-09_14:00:10.528462) 14:00:12.230410 run osmo-hlr_10.42.42.2(pid=13749): stderr: | 20221209140010702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140010702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140010702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140010702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140010702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140010703 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140010716 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140010725 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140010725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140010725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:12.374630 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=13749): Process ended prematurely: osmo-hlr_10.42.42.2(pid=13749) [trial-2360↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13749)] [trial-2360↪smpp↪esme_connect_policy_acceptall.py:23] 14:00:12.382972 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.3 sec) 14:00:12.408861 run osmo-msc_10.42.42.5(pid=13752): ERR: Terminated: ERROR {rc=9} [trial-2360↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=13752)] 14:00:12.456756 run osmo-msc_10.42.42.5(pid=13752): stdout: | (launched: 2022-12-09_14:00:11.497678) 14:00:12.506354 run osmo-msc_10.42.42.5(pid=13752): stderr: | 20221209140011812 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209140011812 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209140011813 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140011813 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209140011813 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209140011813 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209140011814 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209140011814 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209140011814 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 14:00:12.556917 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13744): Terminating (SIGTERM) 14:00:12.598699 run osmo-stp_10.42.42.4(pid=13745): Terminating (SIGTERM) 14:00:12.639922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13748): Terminating (SIGTERM) 14:00:12.700486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13751): Terminating (SIGTERM) 14:00:12.753282 --- ParallelTerminationStrategy: PID 13744 died... 14:00:12.773349 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13744): Terminated: ok {rc=0} 14:00:12.843338 --- ParallelTerminationStrategy: PID 13745 died... 14:00:12.863883 run osmo-stp_10.42.42.4(pid=13745): Terminated: ok {rc=0} 14:00:12.913232 --- ParallelTerminationStrategy: PID 13748 died... 14:00:12.934089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13748): Terminated: ok {rc=0} 14:00:12.983687 --- ParallelTerminationStrategy: PID 13751 died... 14:00:13.004363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13751): Terminated: ok {rc=0} ---------------------------------------------- trial-2360 smpp esme_connect_policy_closed.py ---------------------------------------------- 14:00:13.061757 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:13.074335 tst smpp: Using 1 x bts (candidates: 1) 14:00:13.117111 tst esme_connect_policy_closed.py: using LAC 21946 14:00:13.241838 tst esme_connect_policy_closed.py: using RAC 16 14:00:13.363459 tst esme_connect_policy_closed.py: using CellId 21946 14:00:13.496304 tst esme_connect_policy_closed.py: using BVCI 21947 14:00:13.623478 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:13.635631 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:13.647949 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:13.671282 tst esme_connect_policy_closed.py: using MSISDN 7246 14:00:13.806752 tst esme_connect_policy_closed.py: using MSISDN 7247 14:00:13.929819 run osmo-stp_10.42.42.4: Starting osmo-stp 14:00:14.501391 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14040): Launched 14:00:14.824424 run osmo-stp_10.42.42.4(pid=14107): Launched 14:00:14.941199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:15.412472 run create_hlr_db(pid=14108): Launched 14:00:16.604150 run create_hlr_db(pid=14108): Terminated: ok {rc=0} 14:00:16.982874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14110): Launched 14:00:17.324376 run osmo-hlr_10.42.42.2(pid=14111): Launched 14:00:17.451232 run osmo-msc_10.42.42.5: Starting osmo-msc 14:00:18.043020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14113): Launched 14:00:18.370572 run osmo-msc_10.42.42.5(pid=14114): Launched 14:00:18.552519 run osmo-hlr_10.42.42.2(pid=14111): ERR: Terminated: ERROR {rc=237} [trial-2360↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14111)] 14:00:18.689832 run osmo-hlr_10.42.42.2(pid=14111): stdout: | (launched: 2022-12-09_14:00:17.265837) 14:00:18.832264 run osmo-hlr_10.42.42.2(pid=14111): stderr: | 20221209140017456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140017456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140017456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140017456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140017457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140017457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140017469 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140017478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140017478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140017478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:18.970573 run osmo-hlr_10.42.42.2(pid=14111): stdout: | (launched: 2022-12-09_14:00:17.265837) 14:00:19.100435 run osmo-hlr_10.42.42.2(pid=14111): stderr: | 20221209140017456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140017456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140017456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140017456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140017457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140017457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140017469 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140017478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140017478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140017478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:19.257434 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=14111): Process ended prematurely: osmo-hlr_10.42.42.2(pid=14111) [trial-2360↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14111)] [trial-2360↪smpp↪esme_connect_policy_closed.py:31] 14:00:19.266395 tst esme_connect_policy_closed.py:31: Test FAILED (6.2 sec) 14:00:19.294803 run osmo-msc_10.42.42.5(pid=14114): ERR: Terminated: ERROR {rc=9} [trial-2360↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=14114)] 14:00:19.346625 run osmo-msc_10.42.42.5(pid=14114): stdout: | (launched: 2022-12-09_14:00:18.311673) 14:00:19.399283 run osmo-msc_10.42.42.5(pid=14114): stderr: | 20221209140018675 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209140018675 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209140018675 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140018675 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209140018675 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209140018675 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209140018675 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209140018675 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209140018676 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 14:00:19.452504 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14040): Terminating (SIGTERM) 14:00:19.495356 run osmo-stp_10.42.42.4(pid=14107): Terminating (SIGTERM) 14:00:19.538081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14110): Terminating (SIGTERM) 14:00:19.582776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14113): Terminating (SIGTERM) 14:00:19.627653 --- ParallelTerminationStrategy: PID 14040 died... 14:00:19.648583 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14040): Terminated: ok {rc=0} 14:00:19.699185 --- ParallelTerminationStrategy: PID 14107 died... 14:00:19.718938 run osmo-stp_10.42.42.4(pid=14107): Terminated: ok {rc=0} 14:00:19.765851 --- ParallelTerminationStrategy: PID 14110 died... 14:00:19.785706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14110): Terminated: ok {rc=0} 14:00:19.832853 --- ParallelTerminationStrategy: PID 14113 died... 14:00:19.853050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14113): Terminated: ok {rc=0} ---------------------------------------------- trial-2360 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 14:00:19.905079 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:19.916616 tst smpp: Using 1 x bts (candidates: 1) 14:00:19.953052 tst esme_ms_sms_storeforward.py: using LAC 21947 14:00:20.083949 tst esme_ms_sms_storeforward.py: using RAC 17 14:00:20.211979 tst esme_ms_sms_storeforward.py: using CellId 21947 14:00:20.336232 tst esme_ms_sms_storeforward.py: using BVCI 21948 14:00:20.448783 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:20.459207 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:20.469509 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:20.479886 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:20.490299 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:20.500564 tst smpp: Using 1 x modem (candidates: 1) 14:00:20.626763 tst esme_ms_sms_storeforward.py: using MSISDN 7248 14:00:20.736317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:21.206532 run create_hlr_db(pid=14117): Launched 14:00:22.385427 run create_hlr_db(pid=14117): Terminated: ok {rc=0} 14:00:22.706734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14119): Launched 14:00:23.015008 run osmo-hlr_10.42.42.2(pid=14124): Launched 14:00:23.251912 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:23.898635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14247): Launched 14:00:24.229682 run osmo-stp_10.42.42.5(pid=14298): Launched 14:00:24.486410 run osmo-msc_10.42.42.6: Starting osmo-msc 14:00:25.151538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14300): Launched 14:00:25.495389 run osmo-msc_10.42.42.6(pid=14301): Launched 14:00:25.843179 run osmo-stp_10.42.42.5(pid=14298): ERR: Terminated: ERROR {rc=1} [trial-2360↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14298)] 14:00:26.100191 run osmo-stp_10.42.42.5(pid=14298): stdout: | (launched: 2022-12-09_14:00:24.174075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:26.386059 run osmo-stp_10.42.42.5(pid=14298): stderr: | 20221209140024458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140024458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140024458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140024459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140024459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140024459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140024459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:26.544128 run osmo-stp_10.42.42.5(pid=14298): stdout: | (launched: 2022-12-09_14:00:24.174075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:26.668329 run osmo-stp_10.42.42.5(pid=14298): stderr: | 20221209140024458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140024458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140024458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140024459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140024459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140024459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140024459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:26.816136 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=14298): Process ended prematurely: osmo-stp_10.42.42.5(pid=14298) [trial-2360↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14298)] [trial-2360↪smpp↪esme_ms_sms_storeforward.py:30] 14:00:26.824896 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.9 sec) 14:00:26.851977 run osmo-hlr_10.42.42.2(pid=14124): ERR: Terminated: ERROR {rc=237} [trial-2360↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14124)] 14:00:26.901150 run osmo-hlr_10.42.42.2(pid=14124): stdout: | (launched: 2022-12-09_14:00:22.957254) 14:00:26.951895 run osmo-hlr_10.42.42.2(pid=14124): stderr: | 20221209140023202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140023202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140023202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140023202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140023202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140023202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140023264 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140023272 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140023281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140023281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:27.022970 run osmo-msc_10.42.42.6(pid=14301): ERR: Terminated: ERROR {rc=2} [trial-2360↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14301)] 14:00:27.071972 run osmo-msc_10.42.42.6(pid=14301): stdout: | (launched: 2022-12-09_14:00:25.436089) 14:00:27.122818 run osmo-msc_10.42.42.6(pid=14301): stderr: | 20221209140026021 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140026021 DLGLOBAL DEBUG validating counter group 0x7efc2f148c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140026021 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140026021 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140026022 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140026022 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140026024 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140026024 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140026024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140026024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:00:27.173774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14119): Terminating (SIGTERM) 14:00:27.215505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14247): Terminating (SIGTERM) 14:00:27.258980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14300): Terminating (SIGTERM) 14:00:27.303218 --- ParallelTerminationStrategy: PID 14119 died... 14:00:27.323086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14119): Terminated: ok {rc=0} 14:00:27.369802 --- ParallelTerminationStrategy: PID 14247 died... 14:00:27.389141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14247): Terminated: ok {rc=0} 14:00:27.434115 --- ParallelTerminationStrategy: PID 14300 died... 14:00:27.453285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14300): Terminated: ok {rc=0} 14:00:27.539518 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 smpp esme_ms_sms_transaction.py ---------------------------------------------- 14:00:28.628583 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:28.641126 tst smpp: Using 1 x bts (candidates: 1) 14:00:28.688609 tst esme_ms_sms_transaction.py: using LAC 21948 14:00:28.826354 tst esme_ms_sms_transaction.py: using RAC 18 14:00:28.954442 tst esme_ms_sms_transaction.py: using CellId 21948 14:00:29.079592 tst esme_ms_sms_transaction.py: using BVCI 21949 14:00:29.197290 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:29.208558 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:29.219616 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:29.231045 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:29.242289 tst smpp: Using 1 x ip_address (candidates: 6) 14:00:29.253697 tst smpp: Using 1 x modem (candidates: 1) 14:00:29.383064 tst esme_ms_sms_transaction.py: using MSISDN 7249 14:00:29.500766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:30.003496 run create_hlr_db(pid=14304): Launched 14:00:30.127661 bus /sierra_2: Setting Powered False 14:00:31.198384 run create_hlr_db(pid=14304): Terminated: ok {rc=0} 14:00:31.748655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14306): Launched 14:00:32.114877 run osmo-hlr_10.42.42.2(pid=14307): Launched 14:00:32.286327 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:32.845178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14309): Launched 14:00:33.170064 run osmo-stp_10.42.42.5(pid=14310): Launched 14:00:33.294497 run osmo-msc_10.42.42.6: Starting osmo-msc 14:00:33.878346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14312): Launched 14:00:34.201934 run osmo-msc_10.42.42.6(pid=14313): Launched 14:00:34.385289 run osmo-stp_10.42.42.5(pid=14310): ERR: Terminated: ERROR {rc=1} [trial-2360↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14310)] 14:00:34.522596 run osmo-stp_10.42.42.5(pid=14310): stdout: | (launched: 2022-12-09_14:00:33.111505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:34.660669 run osmo-stp_10.42.42.5(pid=14310): stderr: | 20221209140033304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140033304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140033304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140033304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140033307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140033307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140033307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:34.797705 run osmo-stp_10.42.42.5(pid=14310): stdout: | (launched: 2022-12-09_14:00:33.111505) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:34.927191 run osmo-stp_10.42.42.5(pid=14310): stderr: | 20221209140033304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140033304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140033304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140033304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140033307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140033307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140033307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:35.081962 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=14310): Process ended prematurely: osmo-stp_10.42.42.5(pid=14310) [trial-2360↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14310)] [trial-2360↪smpp↪esme_ms_sms_transaction.py:28] 14:00:35.091068 tst esme_ms_sms_transaction.py:28: Test FAILED (6.5 sec) 14:00:35.119248 run osmo-hlr_10.42.42.2(pid=14307): ERR: Terminated: ERROR {rc=237} [trial-2360↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14307)] 14:00:35.170215 run osmo-hlr_10.42.42.2(pid=14307): stdout: | (launched: 2022-12-09_14:00:32.052274) 14:00:35.223415 run osmo-hlr_10.42.42.2(pid=14307): stderr: | 20221209140032291 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140032291 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140032291 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140032291 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140032291 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140032292 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140032304 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140032312 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140032313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140032313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:35.296855 run osmo-msc_10.42.42.6(pid=14313): ERR: Terminated: ERROR {rc=2} [trial-2360↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14313)] 14:00:35.348032 run osmo-msc_10.42.42.6(pid=14313): stdout: | (launched: 2022-12-09_14:00:34.143048) 14:00:35.401314 run osmo-msc_10.42.42.6(pid=14313): stderr: | 20221209140034465 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140034465 DLGLOBAL DEBUG validating counter group 0x7faa4a96ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140034465 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140034465 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140034466 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140034466 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140034468 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140034468 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140034468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140034468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:00:35.454442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14306): Terminating (SIGTERM) 14:00:35.496999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14309): Terminating (SIGTERM) 14:00:35.539622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14312): Terminating (SIGTERM) 14:00:35.582307 --- ParallelTerminationStrategy: PID 14306 died... 14:00:35.602550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14306): Terminated: ok {rc=0} 14:00:35.650227 --- ParallelTerminationStrategy: PID 14309 died... 14:00:35.670160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14309): Terminated: ok {rc=0} 14:00:35.717217 --- ParallelTerminationStrategy: PID 14312 died... 14:00:35.737114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14312): Terminated: ok {rc=0} 14:00:35.826422 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 encryption --------------------------------------------------------------------- 14:00:37.020487 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:00:37.024051 tst encryption: Verifying 1 x bts (candidates: 11) 14:00:37.046430 tst encryption: Verifying 6 x ip_address (candidates: 9) 14:00:37.074206 tst encryption: Verifying 1 x modem (candidates: 12) 14:00:37.110214 tst encryption: Reserving 1 x bts (candidates: 11) 14:00:37.132412 tst encryption: Reserving 6 x ip_address (candidates: 9) 14:00:37.161232 tst encryption: Reserving 1 x modem (candidates: 12) 14:00:37.689208 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2360 encryption register_a5_0_authopt.py ---------------------------------------------- 14:00:37.742235 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:37.752783 tst encryption: Using 1 x bts (candidates: 1) 14:00:37.788581 tst register_a5_0_authopt.py: using LAC 21949 14:00:37.909902 tst register_a5_0_authopt.py: using RAC 19 14:00:38.029780 tst register_a5_0_authopt.py: using CellId 21949 14:00:38.159113 tst register_a5_0_authopt.py: using BVCI 21950 14:00:38.279430 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:38.290707 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:38.301749 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:38.312662 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:38.324043 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:38.335511 tst encryption: Using 1 x modem (candidates: 1) 14:00:38.451091 tst register_a5_0_authopt.py:8: start network... 14:00:38.660246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:39.138333 run create_hlr_db(pid=14318): Launched 14:00:39.266785 bus /sierra_2: Setting Powered False 14:00:40.328039 run create_hlr_db(pid=14318): Terminated: ok {rc=0} 14:00:40.776262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14320): Launched 14:00:41.104534 run osmo-hlr_10.42.42.2(pid=14321): Launched 14:00:41.231068 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:41.797178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14323): Launched 14:00:42.125604 run osmo-stp_10.42.42.5(pid=14324): Launched 14:00:42.253151 run osmo-msc_10.42.42.6: Starting osmo-msc 14:00:42.842808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14326): Launched 14:00:43.171403 run osmo-msc_10.42.42.6(pid=14327): Launched 14:00:43.355361 run osmo-stp_10.42.42.5(pid=14324): ERR: Terminated: ERROR {rc=1} [trial-2360↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14324)] 14:00:43.494136 run osmo-stp_10.42.42.5(pid=14324): stdout: | (launched: 2022-12-09_14:00:42.066325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:43.633307 run osmo-stp_10.42.42.5(pid=14324): stderr: | 20221209140042260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140042260 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140042261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140042261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140042262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140042262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140042262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:43.771289 run osmo-stp_10.42.42.5(pid=14324): stdout: | (launched: 2022-12-09_14:00:42.066325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:43.902233 run osmo-stp_10.42.42.5(pid=14324): stderr: | 20221209140042260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140042260 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140042261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140042261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140042262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140042262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140042262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:44.058645 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14324): Process ended prematurely: osmo-stp_10.42.42.5(pid=14324) [trial-2360↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14324)] [trial-2360↪encryption↪register_a5_0_authopt.py:8] 14:00:44.068356 tst register_a5_0_authopt.py:8: Test FAILED (6.4 sec) 14:00:44.096750 run osmo-hlr_10.42.42.2(pid=14321): ERR: Terminated: ERROR {rc=237} [trial-2360↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14321)] 14:00:44.147989 run osmo-hlr_10.42.42.2(pid=14321): stdout: | (launched: 2022-12-09_14:00:41.045319) 14:00:44.200414 run osmo-hlr_10.42.42.2(pid=14321): stderr: | 20221209140041247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140041247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140041247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140041247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140041247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140041247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140041258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140041266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140041266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140041266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:44.273919 run osmo-msc_10.42.42.6(pid=14327): ERR: Terminated: ERROR {rc=2} [trial-2360↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14327)] 14:00:44.324152 run osmo-msc_10.42.42.6(pid=14327): stdout: | (launched: 2022-12-09_14:00:43.111950) 14:00:44.376521 run osmo-msc_10.42.42.6(pid=14327): stderr: | 20221209140043436 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140043437 DLGLOBAL DEBUG validating counter group 0x7fe68b8d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140043437 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140043437 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140043437 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140043437 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140043439 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140043439 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140043439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140043440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:00:44.429358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14320): Terminating (SIGTERM) 14:00:44.471980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14323): Terminating (SIGTERM) 14:00:44.514717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14326): Terminating (SIGTERM) 14:00:44.557530 --- ParallelTerminationStrategy: PID 14320 died... 14:00:44.577803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14320): Terminated: ok {rc=0} 14:00:44.625006 --- ParallelTerminationStrategy: PID 14323 died... 14:00:44.644680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14323): Terminated: ok {rc=0} 14:00:44.691862 --- ParallelTerminationStrategy: PID 14326 died... 14:00:44.711530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14326): Terminated: ok {rc=0} 14:00:44.799735 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 encryption register_a5_0_authreq.py ---------------------------------------------- 14:00:45.956339 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:45.969364 tst encryption: Using 1 x bts (candidates: 1) 14:00:46.012463 tst register_a5_0_authreq.py: using LAC 21950 14:00:46.143904 tst register_a5_0_authreq.py: using RAC 20 14:00:46.276797 tst register_a5_0_authreq.py: using CellId 21950 14:00:46.417484 tst register_a5_0_authreq.py: using BVCI 21951 14:00:46.534649 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:46.545702 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:46.556564 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:46.567756 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:46.579060 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:46.589931 tst encryption: Using 1 x modem (candidates: 1) 14:00:46.729597 tst register_a5_0_authreq.py:8: start network... 14:00:46.964290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:47.478738 run create_hlr_db(pid=14329): Launched 14:00:47.607359 bus /sierra_2: Setting Powered False 14:00:48.671935 run create_hlr_db(pid=14329): Terminated: ok {rc=0} 14:00:49.127063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14331): Launched 14:00:49.457187 run osmo-hlr_10.42.42.2(pid=14332): Launched 14:00:49.585420 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:50.147750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14334): Launched 14:00:50.474500 run osmo-stp_10.42.42.5(pid=14335): Launched 14:00:50.594770 run osmo-msc_10.42.42.6: Starting osmo-msc 14:00:51.155792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14337): Launched 14:00:51.463279 run osmo-msc_10.42.42.6(pid=14338): Launched 14:00:51.639355 run osmo-stp_10.42.42.5(pid=14335): ERR: Terminated: ERROR {rc=1} [trial-2360↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14335)] 14:00:51.769325 run osmo-stp_10.42.42.5(pid=14335): stdout: | (launched: 2022-12-09_14:00:50.415463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:51.899705 run osmo-stp_10.42.42.5(pid=14335): stderr: | 20221209140050589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140050589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140050589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140050589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140050590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140050590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140050590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:52.027428 run osmo-stp_10.42.42.5(pid=14335): stdout: | (launched: 2022-12-09_14:00:50.415463) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:52.149634 run osmo-stp_10.42.42.5(pid=14335): stderr: | 20221209140050589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140050589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140050589 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140050589 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140050590 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140050590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140050590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:52.295561 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14335): Process ended prematurely: osmo-stp_10.42.42.5(pid=14335) [trial-2360↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14335)] [trial-2360↪encryption↪register_a5_0_authreq.py:8] 14:00:52.304578 tst register_a5_0_authreq.py:8: Test FAILED (6.4 sec) 14:00:52.330875 run osmo-hlr_10.42.42.2(pid=14332): ERR: Terminated: ERROR {rc=237} [trial-2360↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14332)] 14:00:52.378304 run osmo-hlr_10.42.42.2(pid=14332): stdout: | (launched: 2022-12-09_14:00:49.398128) 14:00:52.427153 run osmo-hlr_10.42.42.2(pid=14332): stderr: | 20221209140049596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140049596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140049596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140049596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140049596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140049596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140049608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140049618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140049618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140049618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:52.495706 run osmo-msc_10.42.42.6(pid=14338): ERR: Terminated: ERROR {rc=2} [trial-2360↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14338)] 14:00:52.542990 run osmo-msc_10.42.42.6(pid=14338): stdout: | (launched: 2022-12-09_14:00:51.407265) 14:00:52.592216 run osmo-msc_10.42.42.6(pid=14338): stderr: | 20221209140051681 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140051681 DLGLOBAL DEBUG validating counter group 0x7f853270fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140051681 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140051681 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140051682 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140051682 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140051683 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140051684 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140051684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140051684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:00:52.641418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14331): Terminating (SIGTERM) 14:00:52.681825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14334): Terminating (SIGTERM) 14:00:52.721741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14337): Terminating (SIGTERM) 14:00:52.761828 --- ParallelTerminationStrategy: PID 14331 died... 14:00:52.780927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14331): Terminated: ok {rc=0} 14:00:52.825087 --- ParallelTerminationStrategy: PID 14334 died... 14:00:52.843945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14334): Terminated: ok {rc=0} 14:00:52.887767 --- ParallelTerminationStrategy: PID 14337 died... 14:00:52.906522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14337): Terminated: ok {rc=0} 14:00:52.992353 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 encryption register_a5_1_authreq.py ---------------------------------------------- 14:00:54.141742 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:54.153049 tst encryption: Using 1 x bts (candidates: 1) 14:00:54.189509 tst register_a5_1_authreq.py: using LAC 21951 14:00:54.312018 tst register_a5_1_authreq.py: using RAC 21 14:00:54.434783 tst register_a5_1_authreq.py: using CellId 21951 14:00:54.555093 tst register_a5_1_authreq.py: using BVCI 21952 14:00:54.668661 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:54.679192 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:54.689626 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:54.700427 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:54.711285 tst encryption: Using 1 x ip_address (candidates: 6) 14:00:54.722085 tst encryption: Using 1 x modem (candidates: 1) 14:00:54.837134 tst register_a5_1_authreq.py:8: start network... 14:00:55.043154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:55.519447 run create_hlr_db(pid=14340): Launched 14:00:55.644615 bus /sierra_2: Setting Powered False 14:00:56.706195 run create_hlr_db(pid=14340): Terminated: ok {rc=0} 14:00:57.133111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14342): Launched 14:00:57.439730 run osmo-hlr_10.42.42.2(pid=14343): Launched 14:00:57.557484 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:58.101948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14345): Launched 14:00:58.407412 run osmo-stp_10.42.42.5(pid=14346): Launched 14:00:58.526430 run osmo-msc_10.42.42.6: Starting osmo-msc 14:00:59.095722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14348): Launched 14:00:59.401847 run osmo-msc_10.42.42.6(pid=14349): Launched 14:00:59.574316 run osmo-stp_10.42.42.5(pid=14346): ERR: Terminated: ERROR {rc=1} [trial-2360↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14346)] 14:00:59.703953 run osmo-stp_10.42.42.5(pid=14346): stdout: | (launched: 2022-12-09_14:00:58.351111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:59.833776 run osmo-stp_10.42.42.5(pid=14346): stderr: | 20221209140058522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140058522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140058522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140058523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140058523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140058523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140058523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:59.960713 run osmo-stp_10.42.42.5(pid=14346): stdout: | (launched: 2022-12-09_14:00:58.351111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:00.082509 run osmo-stp_10.42.42.5(pid=14346): stderr: | 20221209140058522 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140058522 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140058522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140058523 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140058523 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140058523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140058523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:00.228072 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14346): Process ended prematurely: osmo-stp_10.42.42.5(pid=14346) [trial-2360↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14346)] [trial-2360↪encryption↪register_a5_1_authreq.py:8] 14:01:00.236881 tst register_a5_1_authreq.py:8: Test FAILED (6.1 sec) 14:01:00.262954 run osmo-hlr_10.42.42.2(pid=14343): ERR: Terminated: ERROR {rc=237} [trial-2360↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14343)] 14:01:00.310213 run osmo-hlr_10.42.42.2(pid=14343): stdout: | (launched: 2022-12-09_14:00:57.383643) 14:01:00.359113 run osmo-hlr_10.42.42.2(pid=14343): stderr: | 20221209140057564 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140057564 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140057564 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140057564 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140057565 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140057565 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140057577 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140057588 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140057588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140057588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:00.427613 run osmo-msc_10.42.42.6(pid=14349): ERR: Terminated: ERROR {rc=2} [trial-2360↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14349)] 14:01:00.475283 run osmo-msc_10.42.42.6(pid=14349): stdout: | (launched: 2022-12-09_14:00:59.345798) 14:01:00.524136 run osmo-msc_10.42.42.6(pid=14349): stderr: | 20221209140059620 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140059620 DLGLOBAL DEBUG validating counter group 0x7fbcd656cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140059620 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140059620 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140059620 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140059620 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140059622 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140059622 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140059623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140059623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:01:00.573428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14342): Terminating (SIGTERM) 14:01:00.612790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14345): Terminating (SIGTERM) 14:01:00.652295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14348): Terminating (SIGTERM) 14:01:00.691890 --- ParallelTerminationStrategy: PID 14342 died... 14:01:00.710942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14342): Terminated: ok {rc=0} 14:01:00.763347 --- ParallelTerminationStrategy: PID 14345 died... 14:01:00.786233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14345): Terminated: ok {rc=0} 14:01:00.846421 --- ParallelTerminationStrategy: PID 14348 died... 14:01:00.880463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14348): Terminated: ok {rc=0} 14:01:00.978964 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2360 encryption register_a5_3_authreq.py ---------------------------------------------- 14:01:02.160725 tst encryption: Using 1 x ip_address (candidates: 6) 14:01:02.177495 tst encryption: Using 1 x bts (candidates: 1) 14:01:02.224484 tst register_a5_3_authreq.py: using LAC 21952 14:01:02.359304 tst register_a5_3_authreq.py: using RAC 22 14:01:02.489768 tst register_a5_3_authreq.py: using CellId 21952 14:01:02.619683 tst register_a5_3_authreq.py: using BVCI 21953 14:01:02.739097 tst encryption: Using 1 x ip_address (candidates: 6) 14:01:02.750250 tst encryption: Using 1 x ip_address (candidates: 6) 14:01:02.761234 tst encryption: Using 1 x ip_address (candidates: 6) 14:01:02.772310 tst encryption: Using 1 x ip_address (candidates: 6) 14:01:02.783356 tst encryption: Using 1 x ip_address (candidates: 6) 14:01:02.794355 tst encryption: Using 1 x modem (candidates: 1) 14:01:02.923757 tst register_a5_3_authreq.py:8: start network... 14:01:03.131391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:03.607721 run create_hlr_db(pid=14351): Launched 14:01:03.734857 bus /sierra_2: Setting Powered False 14:01:04.798637 run create_hlr_db(pid=14351): Terminated: ok {rc=0} 14:01:05.235140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14353): Launched 14:01:05.542425 run osmo-hlr_10.42.42.2(pid=14354): Launched 14:01:05.660336 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:06.188550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14356): Launched 14:01:06.494262 run osmo-stp_10.42.42.5(pid=14357): Launched 14:01:06.611438 run osmo-msc_10.42.42.6: Starting osmo-msc 14:01:07.166286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14359): Launched 14:01:07.473502 run osmo-msc_10.42.42.6(pid=14360): Launched 14:01:07.646625 run osmo-stp_10.42.42.5(pid=14357): ERR: Terminated: ERROR {rc=1} [trial-2360↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14357)] 14:01:07.776795 run osmo-stp_10.42.42.5(pid=14357): stdout: | (launched: 2022-12-09_14:01:06.438464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:07.907072 run osmo-stp_10.42.42.5(pid=14357): stderr: | 20221209140106612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140106612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140106612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140106613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140106613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140106613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140106613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:08.035209 run osmo-stp_10.42.42.5(pid=14357): stdout: | (launched: 2022-12-09_14:01:06.438464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:08.157518 run osmo-stp_10.42.42.5(pid=14357): stderr: | 20221209140106612 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140106612 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140106612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140106613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140106613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140106613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140106613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:08.304040 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14357): Process ended prematurely: osmo-stp_10.42.42.5(pid=14357) [trial-2360↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14357)] [trial-2360↪encryption↪register_a5_3_authreq.py:8] 14:01:08.312911 tst register_a5_3_authreq.py:8: Test FAILED (6.2 sec) 14:01:08.338953 run osmo-hlr_10.42.42.2(pid=14354): ERR: Terminated: ERROR {rc=237} [trial-2360↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14354)] 14:01:08.386525 run osmo-hlr_10.42.42.2(pid=14354): stdout: | (launched: 2022-12-09_14:01:05.485913) 14:01:08.435557 run osmo-hlr_10.42.42.2(pid=14354): stderr: | 20221209140105663 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140105663 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140105663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140105663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140105663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140105663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140105711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140105720 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140105721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140105721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:08.504240 run osmo-msc_10.42.42.6(pid=14360): ERR: Terminated: ERROR {rc=2} [trial-2360↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14360)] 14:01:08.551439 run osmo-msc_10.42.42.6(pid=14360): stdout: | (launched: 2022-12-09_14:01:07.417599) 14:01:08.600395 run osmo-msc_10.42.42.6(pid=14360): stderr: | 20221209140107693 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140107693 DLGLOBAL DEBUG validating counter group 0x7fe5d66efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140107693 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140107693 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140107693 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140107694 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140107695 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140107696 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140107696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140107696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:01:08.649562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14353): Terminating (SIGTERM) 14:01:08.688934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14356): Terminating (SIGTERM) 14:01:08.728625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14359): Terminating (SIGTERM) 14:01:08.768313 --- ParallelTerminationStrategy: PID 14353 died... 14:01:08.787191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14353): Terminated: ok {rc=0} 14:01:08.830809 --- ParallelTerminationStrategy: PID 14356 died... 14:01:08.849155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14356): Terminated: ok {rc=0} 14:01:08.892514 --- ParallelTerminationStrategy: PID 14359 died... 14:01:08.910938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14359): Terminated: ok {rc=0} 14:01:08.996229 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 14:01:10.205049 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:01:10.210149 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 14:01:10.228486 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 14:01:10.255193 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 14:01:10.283245 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 14:01:10.301471 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 14:01:10.327375 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 14:01:10.838183 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2360 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 14:01:10.844781 tst handover.py:11: TEST_CONFIG: {} 14:01:11.065524 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:01:11.081941 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:01:11.105638 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:01:11.157699 tst handover.py: using MSISDN 7250 14:01:11.273027 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7250', subscriber_id=0} 14:01:11.380432 run srsepc_10.42.42.118: Starting srsepc 14:01:13.207256 run rm-remote-dir(pid=14366): Launched 14:01:13.329815 bus /sierra_2: Setting Powered False 14:01:14.395458 run rm-remote-dir(pid=14366): Terminated: ok {rc=0} 14:01:14.834125 run mk-remote-dir(pid=14367): Launched 14:01:16.011982 run mk-remote-dir(pid=14367): Terminated: ok {rc=0} 14:01:16.346252 run scp-inst-to-remote(pid=14368): Launched 14:01:18.577331 run scp-inst-to-remote(pid=14368): Terminated: ok {rc=0} 14:01:18.931983 run rm-remote-dir(pid=14370): Launched 14:01:20.121041 run rm-remote-dir(pid=14370): Terminated: ok {rc=0} 14:01:20.477809 run mk-remote-dir(pid=14371): Launched 14:01:21.664736 run mk-remote-dir(pid=14371): Terminated: ok {rc=0} 14:01:21.950916 run scp-cfg-to-remote(pid=14372): Launched 14:01:23.127220 run scp-cfg-to-remote(pid=14372): Terminated: ok {rc=0} 14:01:23.411274 run scp-db-to-remote(pid=14374): Launched 14:01:24.589368 run scp-db-to-remote(pid=14374): Terminated: ok {rc=0} 14:01:24.719889 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:01:25.026959 run patchelf(pid=14376): Launched 14:01:26.202875 run patchelf(pid=14376): Terminated: ok {rc=0} 14:01:26.333922 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:01:26.641240 run setcap-netadm(pid=14377): Launched 14:01:27.818650 run setcap-netadm(pid=14377): Terminated: ok {rc=0} 14:01:28.140434 run srsepc(pid=14378): Launched 14:01:28.255914 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:01:29.468666 run rm-remote-dir(pid=14379): Launched 14:01:29.655415 run srsepc(pid=14378): ERR: Terminated: ERROR {rc=127} [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14378)] 14:01:29.798148 run srsepc(pid=14378): stdout: | (launched: 2022-12-09_14:01:28.084363) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:01:29.941240 run srsepc(pid=14378): stderr: | (launched: 2022-12-09_14:01:28.130127) | Connection to 10.42.42.116 closed. 14:01:30.084458 run srsepc(pid=14378): stdout: | (launched: 2022-12-09_14:01:28.084363) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:01:30.222845 run srsepc(pid=14378): stderr: | (launched: 2022-12-09_14:01:28.130127) | Connection to 10.42.42.116 closed. 14:01:30.387108 run rm-remote-dir(pid=14379): Terminating (SIGINT) 14:01:30.575609 run rm-remote-dir(pid=14379): Terminated: ok {rc=0} 14:01:30.711615 tst handover.py:37: ERR: Error: srsepc(pid=14378): Process ended prematurely: srsepc(pid=14378) [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14378)] [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 14:01:30.722127 tst handover.py:37: Test FAILED (19.9 sec) 14:01:30.804114 run scp-back-log(pid=14380): Launched 14:01:31.917107 run scp-back-log(pid=14380): ERR: Terminated: ERROR {rc=1} [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=14380)] 14:01:31.988455 run scp-back-log(pid=14380): stdout: | (launched: 2022-12-09_14:01:30.771971) 14:01:32.058504 run scp-back-log(pid=14380): stderr: | (launched: 2022-12-09_14:01:30.792854) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:01:32.137717 tst srsepc_10.42.42.118: Error('scp-back-log(pid=14380): launch_sync(): local process exited with status 1 [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=14380)]') ---------------------------------------------- trial-2360 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 14:01:32.188533 tst iperf3_bidir.py:13: Number of physical ue: 1 14:01:32.414756 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:01:32.461832 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 14:01:32.666402 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:01:32.682117 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:01:32.718720 tst iperf3_bidir.py: using MSISDN 7251 14:01:32.831361 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7251', subscriber_id=0} 14:01:32.938002 run srsepc_10.42.42.118: Starting srsepc 14:01:33.564026 run rm-remote-dir(pid=14382): Launched 14:01:34.744672 run rm-remote-dir(pid=14382): Terminated: ok {rc=0} 14:01:35.080645 run mk-remote-dir(pid=14383): Launched 14:01:36.259237 run mk-remote-dir(pid=14383): Terminated: ok {rc=0} 14:01:36.544725 run scp-inst-to-remote(pid=14384): Launched 14:01:38.728565 run scp-inst-to-remote(pid=14384): Terminated: ok {rc=0} 14:01:39.084299 run rm-remote-dir(pid=14386): Launched 14:01:40.275037 run rm-remote-dir(pid=14386): Terminated: ok {rc=0} 14:01:40.632262 run mk-remote-dir(pid=14387): Launched 14:01:41.821697 run mk-remote-dir(pid=14387): Terminated: ok {rc=0} 14:01:42.133998 run scp-cfg-to-remote(pid=14388): Launched 14:01:43.321732 run scp-cfg-to-remote(pid=14388): Terminated: ok {rc=0} 14:01:43.624392 run scp-db-to-remote(pid=14390): Launched 14:01:44.812766 run scp-db-to-remote(pid=14390): Terminated: ok {rc=0} 14:01:44.952386 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:01:45.281559 run patchelf(pid=14392): Launched 14:01:46.464689 run patchelf(pid=14392): Terminated: ok {rc=0} 14:01:46.601449 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:01:46.919064 run setcap-netadm(pid=14393): Launched 14:01:48.157110 run setcap-netadm(pid=14393): Terminated: ok {rc=0} 14:01:48.480138 run srsepc(pid=14394): Launched 14:01:48.596639 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:01:49.769129 run rm-remote-dir(pid=14395): Launched 14:01:49.956556 run srsepc(pid=14394): ERR: Terminated: ERROR {rc=127} [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14394)] 14:01:50.099383 run srsepc(pid=14394): stdout: | (launched: 2022-12-09_14:01:48.424030) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:01:50.243403 run srsepc(pid=14394): stderr: | (launched: 2022-12-09_14:01:48.469913) | Connection to 10.42.42.116 closed. 14:01:50.386552 run srsepc(pid=14394): stdout: | (launched: 2022-12-09_14:01:48.424030) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:01:50.524413 run srsepc(pid=14394): stderr: | (launched: 2022-12-09_14:01:48.469913) | Connection to 10.42.42.116 closed. 14:01:50.687986 run rm-remote-dir(pid=14395): Terminating (SIGINT) 14:01:50.875661 run rm-remote-dir(pid=14395): Terminated: ok {rc=0} 14:01:51.011630 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=14394): Process ended prematurely: srsepc(pid=14394) [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14394)] [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 14:01:51.022322 tst iperf3_bidir.py:42: Test FAILED (18.8 sec) 14:01:51.103755 run scp-back-log(pid=14396): Launched 14:01:52.184397 run scp-back-log(pid=14396): ERR: Terminated: ERROR {rc=1} [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=14396)] 14:01:52.249417 run scp-back-log(pid=14396): stdout: | (launched: 2022-12-09_14:01:51.071738) 14:01:52.315700 run scp-back-log(pid=14396): stderr: | (launched: 2022-12-09_14:01:51.092734) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:01:52.389903 tst srsepc_10.42.42.118: Error('scp-back-log(pid=14396): launch_sync(): local process exited with status 1 [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=14396)]') ---------------------------------------------- trial-2360 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 14:01:52.437790 tst iperf3_dl.py:13: Number of physical ue: 1 14:01:52.659155 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:01:52.704610 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 14:01:52.922550 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:01:52.938755 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:01:52.973893 tst iperf3_dl.py: using MSISDN 7252 14:01:53.094763 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7252', subscriber_id=0} 14:01:53.210056 run srsepc_10.42.42.118: Starting srsepc 14:01:53.880785 run rm-remote-dir(pid=14398): Launched 14:01:55.072020 run rm-remote-dir(pid=14398): Terminated: ok {rc=0} 14:01:55.430220 run mk-remote-dir(pid=14399): Launched 14:01:56.621581 run mk-remote-dir(pid=14399): Terminated: ok {rc=0} 14:01:56.926269 run scp-inst-to-remote(pid=14400): Launched 14:01:59.115358 run scp-inst-to-remote(pid=14400): Terminated: ok {rc=0} 14:01:59.472305 run rm-remote-dir(pid=14402): Launched 14:02:00.663041 run rm-remote-dir(pid=14402): Terminated: ok {rc=0} 14:02:01.034678 run mk-remote-dir(pid=14403): Launched 14:02:02.317480 run mk-remote-dir(pid=14403): Terminated: ok {rc=0} 14:02:02.605320 run scp-cfg-to-remote(pid=14404): Launched 14:02:03.782964 run scp-cfg-to-remote(pid=14404): Terminated: ok {rc=0} 14:02:04.067535 run scp-db-to-remote(pid=14406): Launched 14:02:05.246434 run scp-db-to-remote(pid=14406): Terminated: ok {rc=0} 14:02:05.377849 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:02:05.686788 run patchelf(pid=14408): Launched 14:02:06.865829 run patchelf(pid=14408): Terminated: ok {rc=0} 14:02:06.997687 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:02:07.305334 run setcap-netadm(pid=14409): Launched 14:02:08.481983 run setcap-netadm(pid=14409): Terminated: ok {rc=0} 14:02:08.806213 run srsepc(pid=14410): Launched 14:02:08.922967 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:02:10.034301 run rm-remote-dir(pid=14411): Launched 14:02:10.213822 run srsepc(pid=14410): ERR: Terminated: ERROR {rc=127} [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14410)] 14:02:10.349560 run srsepc(pid=14410): stdout: | (launched: 2022-12-09_14:02:08.750222) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:02:10.484348 run srsepc(pid=14410): stderr: | (launched: 2022-12-09_14:02:08.795944) | Connection to 10.42.42.116 closed. 14:02:10.618936 run srsepc(pid=14410): stdout: | (launched: 2022-12-09_14:02:08.750222) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:02:10.748205 run srsepc(pid=14410): stderr: | (launched: 2022-12-09_14:02:08.795944) | Connection to 10.42.42.116 closed. 14:02:10.901430 run rm-remote-dir(pid=14411): Terminating (SIGINT) 14:02:11.077468 run rm-remote-dir(pid=14411): Terminated: ok {rc=0} 14:02:11.204896 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=14410): Process ended prematurely: srsepc(pid=14410) [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14410)] [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 14:02:11.214961 tst iperf3_dl.py:42: Test FAILED (18.8 sec) 14:02:11.291816 run scp-back-log(pid=14412): Launched 14:02:12.369644 run scp-back-log(pid=14412): ERR: Terminated: ERROR {rc=1} [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=14412)] 14:02:12.431070 run scp-back-log(pid=14412): stdout: | (launched: 2022-12-09_14:02:11.261587) 14:02:12.494038 run scp-back-log(pid=14412): stderr: | (launched: 2022-12-09_14:02:11.281578) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:02:12.565036 tst srsepc_10.42.42.118: Error('scp-back-log(pid=14412): launch_sync(): local process exited with status 1 [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=14412)]') ---------------------------------------------- trial-2360 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 14:02:12.610544 tst iperf3_ul.py:13: Number of physical ue: 1 14:02:12.815376 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:02:12.861490 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 14:02:13.065236 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:02:13.080843 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:02:13.111786 tst iperf3_ul.py: using MSISDN 7253 14:02:13.222188 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7253', subscriber_id=0} 14:02:13.328462 run srsepc_10.42.42.118: Starting srsepc 14:02:13.954250 run rm-remote-dir(pid=14414): Launched 14:02:15.138179 run rm-remote-dir(pid=14414): Terminated: ok {rc=0} 14:02:15.497743 run mk-remote-dir(pid=14415): Launched 14:02:16.687412 run mk-remote-dir(pid=14415): Terminated: ok {rc=0} 14:02:16.986628 run scp-inst-to-remote(pid=14416): Launched 14:02:19.224397 run scp-inst-to-remote(pid=14416): Terminated: ok {rc=0} 14:02:19.558494 run rm-remote-dir(pid=14418): Launched 14:02:20.741814 run rm-remote-dir(pid=14418): Terminated: ok {rc=0} 14:02:21.077619 run mk-remote-dir(pid=14419): Launched 14:02:22.258437 run mk-remote-dir(pid=14419): Terminated: ok {rc=0} 14:02:22.544730 run scp-cfg-to-remote(pid=14420): Launched 14:02:23.722399 run scp-cfg-to-remote(pid=14420): Terminated: ok {rc=0} 14:02:24.006730 run scp-db-to-remote(pid=14422): Launched 14:02:25.185227 run scp-db-to-remote(pid=14422): Terminated: ok {rc=0} 14:02:25.317109 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:02:25.625529 run patchelf(pid=14424): Launched 14:02:26.803564 run patchelf(pid=14424): Terminated: ok {rc=0} 14:02:26.935405 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:02:27.245037 run setcap-netadm(pid=14425): Launched 14:02:28.422871 run setcap-netadm(pid=14425): Terminated: ok {rc=0} 14:02:28.747870 run srsepc(pid=14426): Launched 14:02:28.863900 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:02:30.040286 run rm-remote-dir(pid=14427): Launched 14:02:30.227232 run srsepc(pid=14426): ERR: Terminated: ERROR {rc=127} [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14426)] 14:02:30.370751 run srsepc(pid=14426): stdout: | (launched: 2022-12-09_14:02:28.691733) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:02:30.514479 run srsepc(pid=14426): stderr: | (launched: 2022-12-09_14:02:28.737585) | Connection to 10.42.42.116 closed. 14:02:30.658214 run srsepc(pid=14426): stdout: | (launched: 2022-12-09_14:02:28.691733) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:02:30.796365 run srsepc(pid=14426): stderr: | (launched: 2022-12-09_14:02:28.737585) | Connection to 10.42.42.116 closed. 14:02:30.994175 run rm-remote-dir(pid=14427): Terminating (SIGINT) 14:02:31.180273 run rm-remote-dir(pid=14427): Terminated: ok {rc=0} 14:02:31.313563 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=14426): Process ended prematurely: srsepc(pid=14426) [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14426)] [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 14:02:31.325101 tst iperf3_ul.py:42: Test FAILED (18.7 sec) 14:02:31.407173 run scp-back-log(pid=14428): Launched 14:02:32.525612 run scp-back-log(pid=14428): ERR: Terminated: ERROR {rc=1} [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=14428)] 14:02:32.586383 run scp-back-log(pid=14428): stdout: | (launched: 2022-12-09_14:02:31.373289) 14:02:32.648353 run scp-back-log(pid=14428): stderr: | (launched: 2022-12-09_14:02:31.393370) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:02:32.717963 tst srsepc_10.42.42.118: Error('scp-back-log(pid=14428): launch_sync(): local process exited with status 1 [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=14428)]') ---------------------------------------------- trial-2360 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 14:02:32.763590 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:02:32.780050 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:02:32.802677 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:02:32.851269 tst ping.py: using MSISDN 7254 14:02:32.965821 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7254', subscriber_id=0} 14:02:33.072670 run srsepc_10.42.42.118: Starting srsepc 14:02:33.700179 run rm-remote-dir(pid=14430): Launched 14:02:34.879326 run rm-remote-dir(pid=14430): Terminated: ok {rc=0} 14:02:35.213906 run mk-remote-dir(pid=14431): Launched 14:02:36.393872 run mk-remote-dir(pid=14431): Terminated: ok {rc=0} 14:02:36.678911 run scp-inst-to-remote(pid=14434): Launched 14:02:38.858205 run scp-inst-to-remote(pid=14434): Terminated: ok {rc=0} 14:02:39.190311 run rm-remote-dir(pid=14436): Launched 14:02:40.371067 run rm-remote-dir(pid=14436): Terminated: ok {rc=0} 14:02:40.706489 run mk-remote-dir(pid=14437): Launched 14:02:41.885611 run mk-remote-dir(pid=14437): Terminated: ok {rc=0} 14:02:42.171565 run scp-cfg-to-remote(pid=14438): Launched 14:02:43.349191 run scp-cfg-to-remote(pid=14438): Terminated: ok {rc=0} 14:02:43.631464 run scp-db-to-remote(pid=14440): Launched 14:02:44.807641 run scp-db-to-remote(pid=14440): Terminated: ok {rc=0} 14:02:44.939573 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:02:45.246720 run patchelf(pid=14442): Launched 14:02:46.452258 run patchelf(pid=14442): Terminated: ok {rc=0} 14:02:46.603681 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:02:46.939594 run setcap-netadm(pid=14443): Launched 14:02:48.194383 run setcap-netadm(pid=14443): Terminated: ok {rc=0} 14:02:48.539828 run srsepc(pid=14444): Launched 14:02:48.661231 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:02:49.840046 run rm-remote-dir(pid=14445): Launched 14:02:50.027340 run srsepc(pid=14444): ERR: Terminated: ERROR {rc=127} [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14444)] 14:02:50.170113 run srsepc(pid=14444): stdout: | (launched: 2022-12-09_14:02:48.480256) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:02:50.314385 run srsepc(pid=14444): stderr: | (launched: 2022-12-09_14:02:48.529286) | Connection to 10.42.42.116 closed. 14:02:50.458753 run srsepc(pid=14444): stdout: | (launched: 2022-12-09_14:02:48.480256) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:02:50.597273 run srsepc(pid=14444): stderr: | (launched: 2022-12-09_14:02:48.529286) | Connection to 10.42.42.116 closed. 14:02:50.760913 run rm-remote-dir(pid=14445): Terminating (SIGINT) 14:02:50.949212 run rm-remote-dir(pid=14445): Terminated: ok {rc=0} 14:02:51.085506 tst ping.py:16: ERR: Error: srsepc(pid=14444): Process ended prematurely: srsepc(pid=14444) [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14444)] [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 14:02:51.096057 tst ping.py:16: Test FAILED (18.3 sec) 14:02:51.177241 run scp-back-log(pid=14446): Launched 14:02:52.258166 run scp-back-log(pid=14446): ERR: Terminated: ERROR {rc=1} [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=14446)] 14:02:52.322699 run scp-back-log(pid=14446): stdout: | (launched: 2022-12-09_14:02:51.145546) 14:02:52.388484 run scp-back-log(pid=14446): stderr: | (launched: 2022-12-09_14:02:51.166217) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:02:52.462899 tst srsepc_10.42.42.118: Error('scp-back-log(pid=14446): launch_sync(): local process exited with status 1 [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=14446)]') ---------------------------------------------- trial-2360 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 14:02:52.510830 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:02:52.527833 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:02:52.551630 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:02:52.603182 tst rrc_idle_mo_ping.py: using MSISDN 7255 14:02:52.717226 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7255', subscriber_id=0} 14:02:52.823853 run srsepc_10.42.42.118: Starting srsepc 14:02:53.448577 run rm-remote-dir(pid=14448): Launched 14:02:54.628096 run rm-remote-dir(pid=14448): Terminated: ok {rc=0} 14:02:54.962520 run mk-remote-dir(pid=14449): Launched 14:02:56.142375 run mk-remote-dir(pid=14449): Terminated: ok {rc=0} 14:02:56.427338 run scp-inst-to-remote(pid=14450): Launched 14:02:58.607147 run scp-inst-to-remote(pid=14450): Terminated: ok {rc=0} 14:02:58.939761 run rm-remote-dir(pid=14452): Launched 14:03:00.119247 run rm-remote-dir(pid=14452): Terminated: ok {rc=0} 14:03:00.453374 run mk-remote-dir(pid=14453): Launched 14:03:01.653617 run mk-remote-dir(pid=14453): Terminated: ok {rc=0} 14:03:01.954776 run scp-cfg-to-remote(pid=14455): Launched 14:03:03.191814 run scp-cfg-to-remote(pid=14455): Terminated: ok {rc=0} 14:03:03.475086 run scp-db-to-remote(pid=14457): Launched 14:03:04.651447 run scp-db-to-remote(pid=14457): Terminated: ok {rc=0} 14:03:04.782391 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:03:05.089115 run patchelf(pid=14459): Launched 14:03:06.266554 run patchelf(pid=14459): Terminated: ok {rc=0} 14:03:06.397549 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:03:06.705584 run setcap-netadm(pid=14460): Launched 14:03:07.882057 run setcap-netadm(pid=14460): Terminated: ok {rc=0} 14:03:08.204892 run srsepc(pid=14461): Launched 14:03:08.319964 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:03:09.426247 run rm-remote-dir(pid=14462): Launched 14:03:09.603646 run srsepc(pid=14461): ERR: Terminated: ERROR {rc=127} [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14461)] 14:03:09.739125 run srsepc(pid=14461): stdout: | (launched: 2022-12-09_14:03:08.148811) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:03:09.873708 run srsepc(pid=14461): stderr: | (launched: 2022-12-09_14:03:08.194647) | Connection to 10.42.42.116 closed. 14:03:10.008432 run srsepc(pid=14461): stdout: | (launched: 2022-12-09_14:03:08.148811) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:03:10.137621 run srsepc(pid=14461): stderr: | (launched: 2022-12-09_14:03:08.194647) | Connection to 10.42.42.116 closed. 14:03:10.290416 run rm-remote-dir(pid=14462): Terminating (SIGINT) 14:03:10.466707 run rm-remote-dir(pid=14462): Terminated: ok {rc=0} 14:03:10.594477 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=14461): Process ended prematurely: srsepc(pid=14461) [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14461)] [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 14:03:10.604325 tst rrc_idle_mo_ping.py:16: Test FAILED (18.1 sec) 14:03:10.681500 run scp-back-log(pid=14463): Launched 14:03:11.758412 run scp-back-log(pid=14463): ERR: Terminated: ERROR {rc=1} [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=14463)] 14:03:11.818973 run scp-back-log(pid=14463): stdout: | (launched: 2022-12-09_14:03:10.650687) 14:03:11.881209 run scp-back-log(pid=14463): stderr: | (launched: 2022-12-09_14:03:10.670524) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:03:11.951254 tst srsepc_10.42.42.118: Error('scp-back-log(pid=14463): launch_sync(): local process exited with status 1 [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=14463)]') ---------------------------------------------- trial-2360 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 14:03:11.996813 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:03:12.013461 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:03:12.036028 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:03:12.084918 tst rrc_idle_mt_ping.py: using MSISDN 7256 14:03:12.198116 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7256', subscriber_id=0} 14:03:12.304745 run srsepc_10.42.42.118: Starting srsepc 14:03:12.929336 run rm-remote-dir(pid=14465): Launched 14:03:14.108581 run rm-remote-dir(pid=14465): Terminated: ok {rc=0} 14:03:14.444154 run mk-remote-dir(pid=14466): Launched 14:03:15.623271 run mk-remote-dir(pid=14466): Terminated: ok {rc=0} 14:03:15.933790 run scp-inst-to-remote(pid=14467): Launched 14:03:18.132448 run scp-inst-to-remote(pid=14467): Terminated: ok {rc=0} 14:03:18.489345 run rm-remote-dir(pid=14469): Launched 14:03:19.679954 run rm-remote-dir(pid=14469): Terminated: ok {rc=0} 14:03:20.037219 run mk-remote-dir(pid=14470): Launched 14:03:21.226554 run mk-remote-dir(pid=14470): Terminated: ok {rc=0} 14:03:21.531267 run scp-cfg-to-remote(pid=14471): Launched 14:03:22.719576 run scp-cfg-to-remote(pid=14471): Terminated: ok {rc=0} 14:03:23.022154 run scp-db-to-remote(pid=14473): Launched 14:03:24.209861 run scp-db-to-remote(pid=14473): Terminated: ok {rc=0} 14:03:24.350477 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:03:24.678815 run patchelf(pid=14475): Launched 14:03:25.869088 run patchelf(pid=14475): Terminated: ok {rc=0} 14:03:26.009259 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:03:26.338605 run setcap-netadm(pid=14476): Launched 14:03:27.528184 run setcap-netadm(pid=14476): Terminated: ok {rc=0} 14:03:27.872512 run srsepc(pid=14477): Launched 14:03:27.994429 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:03:29.171817 run rm-remote-dir(pid=14478): Launched 14:03:29.359180 run srsepc(pid=14477): ERR: Terminated: ERROR {rc=127} [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14477)] 14:03:29.502490 run srsepc(pid=14477): stdout: | (launched: 2022-12-09_14:03:27.813278) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:03:29.646186 run srsepc(pid=14477): stderr: | (launched: 2022-12-09_14:03:27.862066) | Connection to 10.42.42.116 closed. 14:03:29.789664 run srsepc(pid=14477): stdout: | (launched: 2022-12-09_14:03:27.813278) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:03:29.927828 run srsepc(pid=14477): stderr: | (launched: 2022-12-09_14:03:27.862066) | Connection to 10.42.42.116 closed. 14:03:30.091830 run rm-remote-dir(pid=14478): Terminating (SIGINT) 14:03:30.280164 run rm-remote-dir(pid=14478): Terminated: ok {rc=0} 14:03:30.416871 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=14477): Process ended prematurely: srsepc(pid=14477) [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14477)] [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 14:03:30.427546 tst rrc_idle_mt_ping.py:16: Test FAILED (18.4 sec) 14:03:30.508645 run scp-back-log(pid=14479): Launched 14:03:31.606797 run scp-back-log(pid=14479): ERR: Terminated: ERROR {rc=1} [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=14479)] 14:03:31.698239 run scp-back-log(pid=14479): stdout: | (launched: 2022-12-09_14:03:30.476513) 14:03:31.781830 run scp-back-log(pid=14479): stderr: | (launched: 2022-12-09_14:03:30.497391) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:03:31.860455 tst srsepc_10.42.42.118: Error('scp-back-log(pid=14479): launch_sync(): local process exited with status 1 [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=14479)]') --------------------------------------------------------------------- trial-2360 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 14:03:32.026455 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:03:32.035928 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 14:03:32.095880 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 14:03:32.130463 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 14:03:32.190372 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 14:03:32.235612 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 14:03:32.264688 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 14:03:32.809799 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 14:03:32.816296 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:03:32.827424 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 14:03:32.865401 tst handover.py: using LAC 21953 14:03:32.986857 tst handover.py: using RAC 23 14:03:33.106630 tst handover.py: using CellId 21953 14:03:33.224456 tst handover.py: using BVCI 21954 14:03:33.333869 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 14:03:33.372209 tst handover.py: using LAC 21954 14:03:33.500397 tst handover.py: using RAC 24 14:03:33.626158 tst handover.py: using CellId 21954 14:03:33.753567 tst handover.py: using BVCI 21955 14:03:33.871364 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:03:33.882797 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:03:33.894122 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:03:33.906158 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:03:33.917960 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:03:33.928897 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 14:03:34.045464 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 14:03:34.164409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:34.665701 run create_hlr_db(pid=14484): Launched 14:03:35.856003 run create_hlr_db(pid=14484): Terminated: ok {rc=0} 14:03:36.196272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14486): Launched 14:03:36.519495 run osmo-hlr_10.42.42.2(pid=14487): Launched 14:03:36.643367 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:37.196007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14489): Launched 14:03:37.518038 run osmo-stp_10.42.42.5(pid=14490): Launched 14:03:37.641078 run osmo-msc_10.42.42.6: Starting osmo-msc 14:03:38.223627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14492): Launched 14:03:38.547986 run osmo-msc_10.42.42.6(pid=14493): Launched 14:03:38.727470 run osmo-stp_10.42.42.5(pid=14490): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14490)] 14:03:38.863996 run osmo-stp_10.42.42.5(pid=14490): stdout: | (launched: 2022-12-09_14:03:37.459267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:39.001179 run osmo-stp_10.42.42.5(pid=14490): stderr: | 20221209140337652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140337653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140337653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140337653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140337654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140337654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140337654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:39.137491 run osmo-stp_10.42.42.5(pid=14490): stdout: | (launched: 2022-12-09_14:03:37.459267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:39.265438 run osmo-stp_10.42.42.5(pid=14490): stderr: | 20221209140337652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140337653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140337653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140337653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140337654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140337654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140337654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:39.419209 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14490): Process ended prematurely: osmo-stp_10.42.42.5(pid=14490) [trial-2360↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14490)] [trial-2360↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 14:03:39.428376 tst handover.py:18: Test FAILED (6.6 sec) 14:03:39.456090 run osmo-hlr_10.42.42.2(pid=14487): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14487)] 14:03:39.506408 run osmo-hlr_10.42.42.2(pid=14487): stdout: | (launched: 2022-12-09_14:03:36.460442) 14:03:39.558444 run osmo-hlr_10.42.42.2(pid=14487): stderr: | 20221209140336658 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140336658 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140336658 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140336658 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140336658 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140336658 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140336670 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140336678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140336678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140336679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:39.630745 run osmo-msc_10.42.42.6(pid=14493): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14493)] 14:03:39.680871 run osmo-msc_10.42.42.6(pid=14493): stdout: | (launched: 2022-12-09_14:03:38.488863) 14:03:39.732927 run osmo-msc_10.42.42.6(pid=14493): stderr: | 20221209140338811 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140338811 DLGLOBAL DEBUG validating counter group 0x7f127b454c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140338811 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140338811 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140338811 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140338812 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140338813 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140338814 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140338814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140338814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:03:39.784854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14486): Terminating (SIGTERM) 14:03:39.826802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14489): Terminating (SIGTERM) 14:03:39.868881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14492): Terminating (SIGTERM) 14:03:39.911168 --- ParallelTerminationStrategy: PID 14486 died... 14:03:39.931036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14486): Terminated: ok {rc=0} 14:03:39.977628 --- ParallelTerminationStrategy: PID 14489 died... 14:03:39.996919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14489): Terminated: ok {rc=0} 14:03:40.043390 --- ParallelTerminationStrategy: PID 14492 died... 14:03:40.062905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14492): Terminated: ok {rc=0} 14:03:40.150944 bus /sierra_3: Setting Powered False 14:03:41.250576 bus /sierra_3: Setting Powered False 14:03:42.369694 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 14:03:43.612298 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:03:43.617328 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 14:03:43.657124 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 14:03:43.683430 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 14:03:43.738579 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 14:03:43.780270 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 14:03:43.808006 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 14:03:44.351892 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 14:03:44.357369 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:03:44.368293 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 14:03:44.405628 tst handover.py: using LAC 21955 14:03:44.533889 tst handover.py: using RAC 25 14:03:44.658823 tst handover.py: using CellId 21955 14:03:44.789053 tst handover.py: using BVCI 21956 14:03:44.908330 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 14:03:44.942156 tst handover.py: using LAC 21956 14:03:45.067712 tst handover.py: using RAC 26 14:03:45.192920 tst handover.py: using CellId 21956 14:03:45.317498 tst handover.py: using BVCI 21957 14:03:45.435255 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:03:45.446564 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:03:45.457724 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:03:45.469249 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:03:45.480587 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:03:45.492195 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 14:03:45.607478 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 14:03:45.725218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:46.215524 run create_hlr_db(pid=14498): Launched 14:03:46.380452 bus /sierra_2: Setting Powered False 14:03:47.444483 run create_hlr_db(pid=14498): Terminated: ok {rc=0} 14:03:47.852419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14500): Launched 14:03:48.155277 run osmo-hlr_10.42.42.2(pid=14501): Launched 14:03:48.270949 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:48.763844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14503): Launched 14:03:49.066235 run osmo-stp_10.42.42.5(pid=14504): Launched 14:03:49.181447 run osmo-msc_10.42.42.6: Starting osmo-msc 14:03:49.701318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14506): Launched 14:03:50.003699 run osmo-msc_10.42.42.6(pid=14507): Launched 14:03:50.173813 run osmo-stp_10.42.42.5(pid=14504): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14504)] 14:03:50.302446 run osmo-stp_10.42.42.5(pid=14504): stdout: | (launched: 2022-12-09_14:03:49.010780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:50.430723 run osmo-stp_10.42.42.5(pid=14504): stderr: | 20221209140349179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140349179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140349180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140349180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140349181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140349181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140349181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:50.557452 run osmo-stp_10.42.42.5(pid=14504): stdout: | (launched: 2022-12-09_14:03:49.010780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:50.677551 run osmo-stp_10.42.42.5(pid=14504): stderr: | 20221209140349179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140349179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140349180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140349180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140349181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140349181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140349181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:50.821271 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14504): Process ended prematurely: osmo-stp_10.42.42.5(pid=14504) [trial-2360↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14504)] [trial-2360↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 14:03:50.829672 tst handover.py:18: Test FAILED (6.5 sec) 14:03:50.855772 run osmo-hlr_10.42.42.2(pid=14501): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14501)] 14:03:50.903868 run osmo-hlr_10.42.42.2(pid=14501): stdout: | (launched: 2022-12-09_14:03:48.099718) 14:03:50.953380 run osmo-hlr_10.42.42.2(pid=14501): stderr: | 20221209140348277 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140348277 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140348277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140348277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140348277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140348277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140348289 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140348298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140348298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140348298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:51.022198 run osmo-msc_10.42.42.6(pid=14507): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14507)] 14:03:51.069663 run osmo-msc_10.42.42.6(pid=14507): stdout: | (launched: 2022-12-09_14:03:49.948173) 14:03:51.118951 run osmo-msc_10.42.42.6(pid=14507): stderr: | 20221209140350218 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140350218 DLGLOBAL DEBUG validating counter group 0x7fe846b43c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140350218 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140350219 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140350219 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140350219 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140350222 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140350222 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140350222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140350222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:03:51.169087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14500): Terminating (SIGTERM) 14:03:51.208705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14503): Terminating (SIGTERM) 14:03:51.248380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14506): Terminating (SIGTERM) 14:03:51.288250 --- ParallelTerminationStrategy: PID 14500 died... 14:03:51.307196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14500): Terminated: ok {rc=0} 14:03:51.351281 --- ParallelTerminationStrategy: PID 14503 died... 14:03:51.370265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14503): Terminated: ok {rc=0} 14:03:51.414064 --- ParallelTerminationStrategy: PID 14506 died... 14:03:51.432470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14506): Terminated: ok {rc=0} 14:03:51.516019 bus /sierra_3: Setting Powered False 14:03:52.610693 bus /sierra_3: Setting Powered False 14:03:53.723746 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 14:03:54.970766 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:03:54.976436 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 14:03:55.031428 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 14:03:55.060012 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 14:03:55.111357 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 14:03:55.166525 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 14:03:55.194101 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 14:03:55.743387 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 14:03:55.749730 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:03:55.761010 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:03:55.800186 tst handover.py: using LAC 21957 14:03:55.919204 tst handover.py: using RAC 27 14:03:56.041302 tst handover.py: using CellId 21957 14:03:56.161353 tst handover.py: using BVCI 21958 14:03:56.271251 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:03:56.317911 tst handover.py: using LAC 21958 14:03:56.436336 tst handover.py: using RAC 28 14:03:56.554050 tst handover.py: using CellId 21958 14:03:56.671038 tst handover.py: using BVCI 21959 14:03:56.782262 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:03:56.793265 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:03:56.803868 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:03:56.814856 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:03:56.825874 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:03:56.836720 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:03:56.980818 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:03:57.115166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:57.559068 run create_hlr_db(pid=14514): Launched 14:03:57.674319 bus /sierra_2: Setting Powered False 14:03:58.734096 run create_hlr_db(pid=14514): Terminated: ok {rc=0} 14:03:59.147708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14516): Launched 14:03:59.470045 run osmo-hlr_10.42.42.2(pid=14517): Launched 14:03:59.593398 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:00.120173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14519): Launched 14:04:00.442673 run osmo-stp_10.42.42.5(pid=14520): Launched 14:04:00.565503 run osmo-msc_10.42.42.6: Starting osmo-msc 14:04:01.141941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14522): Launched 14:04:01.480697 run osmo-msc_10.42.42.6(pid=14523): Launched 14:04:01.776166 run osmo-stp_10.42.42.5(pid=14520): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14520)] 14:04:02.024543 run osmo-stp_10.42.42.5(pid=14520): stdout: | (launched: 2022-12-09_14:04:00.383644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:02.381514 run osmo-stp_10.42.42.5(pid=14520): stderr: | 20221209140400576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140400576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140400576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140400576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140400577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140400577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140400577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:02.517090 run osmo-stp_10.42.42.5(pid=14520): stdout: | (launched: 2022-12-09_14:04:00.383644) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:02.645153 run osmo-stp_10.42.42.5(pid=14520): stderr: | 20221209140400576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140400576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140400576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140400576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140400577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140400577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140400577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:02.798483 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14520): Process ended prematurely: osmo-stp_10.42.42.5(pid=14520) [trial-2360↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14520)] [trial-2360↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 14:04:02.807573 tst handover.py:18: Test FAILED (7.1 sec) 14:04:02.834958 run osmo-hlr_10.42.42.2(pid=14517): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14517)] 14:04:02.885090 run osmo-hlr_10.42.42.2(pid=14517): stdout: | (launched: 2022-12-09_14:03:59.411477) 14:04:02.936747 run osmo-hlr_10.42.42.2(pid=14517): stderr: | 20221209140359609 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140359609 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140359609 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140359609 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140359609 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140359609 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140359621 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140359630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140359630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140359630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:03.009210 run osmo-msc_10.42.42.6(pid=14523): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14523)] 14:04:03.059403 run osmo-msc_10.42.42.6(pid=14523): stdout: | (launched: 2022-12-09_14:04:01.421563) 14:04:03.111113 run osmo-msc_10.42.42.6(pid=14523): stderr: | 20221209140402021 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140402021 DLGLOBAL DEBUG validating counter group 0x7fd1860c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140402022 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140402022 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140402022 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140402022 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140402024 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140402024 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140402024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140402024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:04:03.162981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14516): Terminating (SIGTERM) 14:04:03.205167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14519): Terminating (SIGTERM) 14:04:03.247289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14522): Terminating (SIGTERM) 14:04:03.289452 --- ParallelTerminationStrategy: PID 14516 died... 14:04:03.309843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14516): Terminated: ok {rc=0} 14:04:03.356240 --- ParallelTerminationStrategy: PID 14519 died... 14:04:03.376055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14519): Terminated: ok {rc=0} 14:04:03.422010 --- ParallelTerminationStrategy: PID 14522 died... 14:04:03.441687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14522): Terminated: ok {rc=0} 14:04:03.529531 bus /sierra_3: Setting Powered False 14:04:04.629930 bus /sierra_3: Setting Powered False 14:04:05.746006 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 14:04:07.001431 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:04:07.006472 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 14:04:07.057101 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 14:04:07.083735 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 14:04:07.136851 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 14:04:07.186191 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 14:04:07.212357 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 14:04:07.766530 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 14:04:07.771962 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:04:07.783269 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:04:07.821389 tst handover.py: using LAC 21959 14:04:07.938162 tst handover.py: using RAC 29 14:04:08.056795 tst handover.py: using CellId 21959 14:04:08.183339 tst handover.py: using BVCI 21960 14:04:08.302179 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:04:08.346702 tst handover.py: using LAC 21960 14:04:08.472802 tst handover.py: using RAC 30 14:04:08.597896 tst handover.py: using CellId 21960 14:04:08.722244 tst handover.py: using BVCI 21961 14:04:08.839173 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:04:08.850780 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:04:08.862194 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:04:08.873617 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:04:08.884844 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:04:08.896177 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:04:09.014116 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:04:09.134543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:09.606241 run create_hlr_db(pid=14529): Launched 14:04:09.737108 bus /sierra_2: Setting Powered False 14:04:10.800902 run create_hlr_db(pid=14529): Terminated: ok {rc=0} 14:04:11.220411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14531): Launched 14:04:11.542542 run osmo-hlr_10.42.42.2(pid=14532): Launched 14:04:11.665645 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:12.214343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14534): Launched 14:04:12.537743 run osmo-stp_10.42.42.5(pid=14535): Launched 14:04:12.660515 run osmo-msc_10.42.42.6: Starting osmo-msc 14:04:13.219276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14537): Launched 14:04:13.543363 run osmo-msc_10.42.42.6(pid=14538): Launched 14:04:13.723315 run osmo-stp_10.42.42.5(pid=14535): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14535)] 14:04:13.859180 run osmo-stp_10.42.42.5(pid=14535): stdout: | (launched: 2022-12-09_14:04:12.478671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:13.996087 run osmo-stp_10.42.42.5(pid=14535): stderr: | 20221209140412672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140412673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140412673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140412673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140412674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140412674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140412674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:14.132004 run osmo-stp_10.42.42.5(pid=14535): stdout: | (launched: 2022-12-09_14:04:12.478671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:14.260164 run osmo-stp_10.42.42.5(pid=14535): stderr: | 20221209140412672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140412673 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140412673 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140412673 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140412674 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140412674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140412674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:14.414204 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14535): Process ended prematurely: osmo-stp_10.42.42.5(pid=14535) [trial-2360↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14535)] [trial-2360↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 14:04:14.423069 tst handover.py:18: Test FAILED (6.6 sec) 14:04:14.450517 run osmo-hlr_10.42.42.2(pid=14532): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14532)] 14:04:14.500433 run osmo-hlr_10.42.42.2(pid=14532): stdout: | (launched: 2022-12-09_14:04:11.483814) 14:04:14.552268 run osmo-hlr_10.42.42.2(pid=14532): stderr: | 20221209140411684 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140411684 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140411684 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140411684 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140411684 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140411684 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140411709 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140411719 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140411719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140411719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:14.624473 run osmo-msc_10.42.42.6(pid=14538): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14538)] 14:04:14.674410 run osmo-msc_10.42.42.6(pid=14538): stdout: | (launched: 2022-12-09_14:04:13.484243) 14:04:14.725935 run osmo-msc_10.42.42.6(pid=14538): stderr: | 20221209140413806 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140413806 DLGLOBAL DEBUG validating counter group 0x7ff3b8db2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140413806 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140413806 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140413807 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140413807 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140413808 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140413809 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140413809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140413809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:04:14.777688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14531): Terminating (SIGTERM) 14:04:14.819208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14534): Terminating (SIGTERM) 14:04:14.860848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14537): Terminating (SIGTERM) 14:04:14.902863 --- ParallelTerminationStrategy: PID 14531 died... 14:04:14.922875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14531): Terminated: ok {rc=0} 14:04:14.968797 --- ParallelTerminationStrategy: PID 14534 died... 14:04:14.988775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14534): Terminated: ok {rc=0} 14:04:15.034796 --- ParallelTerminationStrategy: PID 14537 died... 14:04:15.054479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14537): Terminated: ok {rc=0} 14:04:15.142180 bus /sierra_3: Setting Powered False 14:04:16.238122 bus /sierra_3: Setting Powered False 14:04:17.365155 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:04:18.628174 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:04:18.634165 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:04:18.689418 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:04:18.716167 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:04:18.767808 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:04:18.821382 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:04:18.847917 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:04:19.400590 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:04:19.406105 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:04:19.417138 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:04:19.456577 tst handover.py: using LAC 21961 14:04:19.583244 tst handover.py: using RAC 31 14:04:19.709835 tst handover.py: using CellId 21961 14:04:19.837192 tst handover.py: using BVCI 21962 14:04:19.954068 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:04:20.004910 tst handover.py: using LAC 21962 14:04:20.133160 tst handover.py: using RAC 32 14:04:20.260611 tst handover.py: using CellId 21962 14:04:20.387361 tst handover.py: using BVCI 21963 14:04:20.504025 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:04:20.515480 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:04:20.526936 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:04:20.538337 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:04:20.549664 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:04:20.560807 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:04:20.679873 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:04:20.795220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:21.237984 run create_hlr_db(pid=14543): Launched 14:04:21.356337 bus /sierra_2: Setting Powered False 14:04:22.416652 run create_hlr_db(pid=14543): Terminated: ok {rc=0} 14:04:22.830893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14545): Launched 14:04:23.153292 run osmo-hlr_10.42.42.2(pid=14546): Launched 14:04:23.277299 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:23.804461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14548): Launched 14:04:24.125557 run osmo-stp_10.42.42.5(pid=14549): Launched 14:04:24.248581 run osmo-msc_10.42.42.6: Starting osmo-msc 14:04:24.803195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14551): Launched 14:04:25.127023 run osmo-msc_10.42.42.6(pid=14552): Launched 14:04:25.309084 run osmo-stp_10.42.42.5(pid=14549): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14549)] 14:04:25.446117 run osmo-stp_10.42.42.5(pid=14549): stdout: | (launched: 2022-12-09_14:04:24.066618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:25.582745 run osmo-stp_10.42.42.5(pid=14549): stderr: | 20221209140424257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140424258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140424258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140424258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140424261 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140424261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140424261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:25.718163 run osmo-stp_10.42.42.5(pid=14549): stdout: | (launched: 2022-12-09_14:04:24.066618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:25.847491 run osmo-stp_10.42.42.5(pid=14549): stderr: | 20221209140424257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140424258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140424258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140424258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140424261 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140424261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140424261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:26.000447 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14549): Process ended prematurely: osmo-stp_10.42.42.5(pid=14549) [trial-2360↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14549)] [trial-2360↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 14:04:26.009554 tst handover.py:18: Test FAILED (6.6 sec) 14:04:26.036693 run osmo-hlr_10.42.42.2(pid=14546): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14546)] 14:04:26.086670 run osmo-hlr_10.42.42.2(pid=14546): stdout: | (launched: 2022-12-09_14:04:23.094348) 14:04:26.138339 run osmo-hlr_10.42.42.2(pid=14546): stderr: | 20221209140423293 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140423293 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140423293 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140423294 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140423294 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140423294 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140423306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140423314 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140423314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140423314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:26.210374 run osmo-msc_10.42.42.6(pid=14552): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14552)] 14:04:26.259949 run osmo-msc_10.42.42.6(pid=14552): stdout: | (launched: 2022-12-09_14:04:25.068322) 14:04:26.311379 run osmo-msc_10.42.42.6(pid=14552): stderr: | 20221209140425389 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140425390 DLGLOBAL DEBUG validating counter group 0x7f8b9783bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140425390 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140425390 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140425390 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140425390 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140425392 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140425392 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140425392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140425392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:04:26.363636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14545): Terminating (SIGTERM) 14:04:26.405174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14548): Terminating (SIGTERM) 14:04:26.446644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14551): Terminating (SIGTERM) 14:04:26.488600 --- ParallelTerminationStrategy: PID 14545 died... 14:04:26.508547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14545): Terminated: ok {rc=0} 14:04:26.554518 --- ParallelTerminationStrategy: PID 14548 died... 14:04:26.574070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14548): Terminated: ok {rc=0} 14:04:26.619586 --- ParallelTerminationStrategy: PID 14551 died... 14:04:26.639228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14551): Terminated: ok {rc=0} 14:04:26.726295 bus /sierra_3: Setting Powered False 14:04:27.824466 bus /sierra_3: Setting Powered False 14:04:28.940912 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 14:04:30.203176 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:04:30.208193 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:04:30.250798 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:04:30.277871 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:04:30.328493 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:04:30.369979 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:04:30.397351 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:04:30.965432 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 14:04:30.970833 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:30.982265 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 14:04:31.022065 tst handover.py: using LAC 21963 14:04:31.148714 tst handover.py: using RAC 33 14:04:31.271190 tst handover.py: using CellId 21963 14:04:31.393085 tst handover.py: using BVCI 21964 14:04:31.529536 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 14:04:31.566597 tst handover.py: using LAC 21964 14:04:31.686412 tst handover.py: using RAC 34 14:04:31.842162 tst handover.py: using CellId 21964 14:04:31.970923 tst handover.py: using BVCI 21965 14:04:32.093445 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:32.105794 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:32.117957 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:32.130574 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:32.144085 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:04:32.156164 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 14:04:32.294553 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 14:04:32.410381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:32.855329 run create_hlr_db(pid=14557): Launched 14:04:32.970996 bus /sierra_2: Setting Powered False 14:04:34.030941 run create_hlr_db(pid=14557): Terminated: ok {rc=0} 14:04:34.427916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14559): Launched 14:04:34.729146 run osmo-hlr_10.42.42.2(pid=14560): Launched 14:04:34.843937 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:35.349940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14562): Launched 14:04:35.649361 run osmo-stp_10.42.42.5(pid=14563): Launched 14:04:35.764374 run osmo-msc_10.42.42.6: Starting osmo-msc 14:04:36.284755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14565): Launched 14:04:36.587058 run osmo-msc_10.42.42.6(pid=14566): Launched 14:04:36.756717 run osmo-stp_10.42.42.5(pid=14563): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14563)] 14:04:36.884883 run osmo-stp_10.42.42.5(pid=14563): stdout: | (launched: 2022-12-09_14:04:35.594611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:37.013125 run osmo-stp_10.42.42.5(pid=14563): stderr: | 20221209140435766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140435766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140435767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140435767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140435767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140435768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140435768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:37.139352 run osmo-stp_10.42.42.5(pid=14563): stdout: | (launched: 2022-12-09_14:04:35.594611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:37.259514 run osmo-stp_10.42.42.5(pid=14563): stderr: | 20221209140435766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140435766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140435767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140435767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140435767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140435768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140435768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:37.402880 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14563): Process ended prematurely: osmo-stp_10.42.42.5(pid=14563) [trial-2360↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14563)] [trial-2360↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 14:04:37.411356 tst handover.py:18: Test FAILED (6.4 sec) 14:04:37.437480 run osmo-hlr_10.42.42.2(pid=14560): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14560)] 14:04:37.485494 run osmo-hlr_10.42.42.2(pid=14560): stdout: | (launched: 2022-12-09_14:04:34.674282) 14:04:37.534715 run osmo-hlr_10.42.42.2(pid=14560): stderr: | 20221209140434852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140434852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140434852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140434852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140434852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140434852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140434864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140434875 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140434875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140434875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:37.603539 run osmo-msc_10.42.42.6(pid=14566): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14566)] 14:04:37.650906 run osmo-msc_10.42.42.6(pid=14566): stdout: | (launched: 2022-12-09_14:04:36.531736) 14:04:37.700049 run osmo-msc_10.42.42.6(pid=14566): stderr: | 20221209140436802 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140436802 DLGLOBAL DEBUG validating counter group 0x7fc1d833dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140436802 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140436802 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140436802 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140436803 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140436804 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140436805 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140436805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140436805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:04:37.749611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14559): Terminating (SIGTERM) 14:04:37.789423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14562): Terminating (SIGTERM) 14:04:37.829368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14565): Terminating (SIGTERM) 14:04:37.870011 --- ParallelTerminationStrategy: PID 14559 died... 14:04:37.889137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14559): Terminated: ok {rc=0} 14:04:37.933447 --- ParallelTerminationStrategy: PID 14562 died... 14:04:37.951823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14562): Terminated: ok {rc=0} 14:04:37.996297 --- ParallelTerminationStrategy: PID 14565 died... 14:04:38.015147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14565): Terminated: ok {rc=0} 14:04:38.099572 bus /sierra_3: Setting Powered False 14:04:39.195377 bus /sierra_3: Setting Powered False 14:04:40.307999 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 14:04:41.556059 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:04:41.561076 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:04:41.614328 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:04:41.640698 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:04:41.693537 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:04:41.746717 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:04:41.773094 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:04:42.323206 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 14:04:42.328313 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:42.339124 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:04:42.376529 tst handover.py: using LAC 21965 14:04:42.495209 tst handover.py: using RAC 35 14:04:42.613473 tst handover.py: using CellId 21965 14:04:42.734194 tst handover.py: using BVCI 21966 14:04:42.846003 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:04:42.894461 tst handover.py: using LAC 21966 14:04:43.012258 tst handover.py: using RAC 36 14:04:43.134488 tst handover.py: using CellId 21966 14:04:43.252659 tst handover.py: using BVCI 21967 14:04:43.371741 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:43.383121 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:43.394458 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:43.405916 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:43.417344 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:04:43.428556 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:04:43.543773 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:04:43.655862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:44.099116 run create_hlr_db(pid=14571): Launched 14:04:44.215617 bus /sierra_2: Setting Powered False 14:04:45.275915 run create_hlr_db(pid=14571): Terminated: ok {rc=0} 14:04:45.690610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14573): Launched 14:04:46.025570 run osmo-hlr_10.42.42.2(pid=14574): Launched 14:04:46.265639 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:46.959013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14576): Launched 14:04:47.280093 run osmo-stp_10.42.42.5(pid=14577): Launched 14:04:47.410146 run osmo-msc_10.42.42.6: Starting osmo-msc 14:04:47.945232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14579): Launched 14:04:48.247744 run osmo-msc_10.42.42.6(pid=14580): Launched 14:04:48.418464 run osmo-stp_10.42.42.5(pid=14577): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14577)] 14:04:48.547154 run osmo-stp_10.42.42.5(pid=14577): stdout: | (launched: 2022-12-09_14:04:47.219096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:48.675547 run osmo-stp_10.42.42.5(pid=14577): stderr: | 20221209140447411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140447411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140447411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140447412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140447414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140447414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140447414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:48.801990 run osmo-stp_10.42.42.5(pid=14577): stdout: | (launched: 2022-12-09_14:04:47.219096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:48.922160 run osmo-stp_10.42.42.5(pid=14577): stderr: | 20221209140447411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140447411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140447411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140447412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140447414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140447414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140447414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:49.066231 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14577): Process ended prematurely: osmo-stp_10.42.42.5(pid=14577) [trial-2360↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14577)] [trial-2360↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 14:04:49.074358 tst handover.py:18: Test FAILED (6.7 sec) 14:04:49.100676 run osmo-hlr_10.42.42.2(pid=14574): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14574)] 14:04:49.148244 run osmo-hlr_10.42.42.2(pid=14574): stdout: | (launched: 2022-12-09_14:04:45.968874) 14:04:49.197371 run osmo-hlr_10.42.42.2(pid=14574): stderr: | 20221209140446313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140446313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140446314 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140446314 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140446314 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140446314 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140446333 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140446342 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140446342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140446342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:49.265978 run osmo-msc_10.42.42.6(pid=14580): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14580)] 14:04:49.313775 run osmo-msc_10.42.42.6(pid=14580): stdout: | (launched: 2022-12-09_14:04:48.192359) 14:04:49.363034 run osmo-msc_10.42.42.6(pid=14580): stderr: | 20221209140448464 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140448464 DLGLOBAL DEBUG validating counter group 0x7f4585f98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140448464 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140448464 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140448464 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140448464 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140448466 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140448467 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140448467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140448467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:04:49.412754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14573): Terminating (SIGTERM) 14:04:49.452468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14576): Terminating (SIGTERM) 14:04:49.492217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14579): Terminating (SIGTERM) 14:04:49.532120 --- ParallelTerminationStrategy: PID 14573 died... 14:04:49.551191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14573): Terminated: ok {rc=0} 14:04:49.595299 --- ParallelTerminationStrategy: PID 14576 died... 14:04:49.613808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14576): Terminated: ok {rc=0} 14:04:49.658240 --- ParallelTerminationStrategy: PID 14579 died... 14:04:49.676926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14579): Terminated: ok {rc=0} 14:04:49.762318 bus /sierra_3: Setting Powered False 14:04:50.861902 bus /sierra_3: Setting Powered False 14:04:51.977295 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 14:04:53.242212 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:04:53.247808 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:04:53.302260 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:04:53.329611 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:04:53.387297 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:04:53.441418 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:04:53.468462 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:04:54.016097 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 14:04:54.021523 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:04:54.032640 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:04:54.071704 tst handover.py: using LAC 21967 14:04:54.198314 tst handover.py: using RAC 37 14:04:54.323323 tst handover.py: using CellId 21967 14:04:54.449088 tst handover.py: using BVCI 21968 14:04:54.566082 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:04:54.613454 tst handover.py: using LAC 21968 14:04:54.739808 tst handover.py: using RAC 38 14:04:54.857390 tst handover.py: using CellId 21968 14:04:54.975282 tst handover.py: using BVCI 21969 14:04:55.086430 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:04:55.097503 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:04:55.108256 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:04:55.119406 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:04:55.130809 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:04:55.141666 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:04:55.261920 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:04:55.376748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:55.821209 run create_hlr_db(pid=14585): Launched 14:04:55.936182 bus /sierra_2: Setting Powered False 14:04:56.997191 run create_hlr_db(pid=14585): Terminated: ok {rc=0} 14:04:57.411594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14587): Launched 14:04:57.736102 run osmo-hlr_10.42.42.2(pid=14588): Launched 14:04:57.854683 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:58.356026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14590): Launched 14:04:58.658713 run osmo-stp_10.42.42.5(pid=14591): Launched 14:04:58.773871 run osmo-msc_10.42.42.6: Starting osmo-msc 14:04:59.294807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14593): Launched 14:04:59.597469 run osmo-msc_10.42.42.6(pid=14594): Launched 14:04:59.766577 run osmo-stp_10.42.42.5(pid=14591): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14591)] 14:04:59.895346 run osmo-stp_10.42.42.5(pid=14591): stdout: | (launched: 2022-12-09_14:04:58.603532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:00.024204 run osmo-stp_10.42.42.5(pid=14591): stderr: | 20221209140458775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140458775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140458775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140458776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140458776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140458776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140458776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:00.150583 run osmo-stp_10.42.42.5(pid=14591): stdout: | (launched: 2022-12-09_14:04:58.603532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:00.270904 run osmo-stp_10.42.42.5(pid=14591): stderr: | 20221209140458775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140458775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140458775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140458776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140458776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140458776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140458776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:00.414541 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14591): Process ended prematurely: osmo-stp_10.42.42.5(pid=14591) [trial-2360↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14591)] [trial-2360↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 14:05:00.422889 tst handover.py:18: Test FAILED (6.4 sec) 14:05:00.449361 run osmo-hlr_10.42.42.2(pid=14588): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14588)] 14:05:00.497171 run osmo-hlr_10.42.42.2(pid=14588): stdout: | (launched: 2022-12-09_14:04:57.677122) 14:05:00.546696 run osmo-hlr_10.42.42.2(pid=14588): stderr: | 20221209140457857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140457857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140457857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140457857 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140457857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140457857 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140457869 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140457877 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140457878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140457878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:00.615252 run osmo-msc_10.42.42.6(pid=14594): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14594)] 14:05:00.663189 run osmo-msc_10.42.42.6(pid=14594): stdout: | (launched: 2022-12-09_14:04:59.542218) 14:05:00.712335 run osmo-msc_10.42.42.6(pid=14594): stderr: | 20221209140459815 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140459816 DLGLOBAL DEBUG validating counter group 0x7f71cdd12c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140459816 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140459816 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140459817 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140459817 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140459818 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140459819 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140459819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140459819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:05:00.762211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14587): Terminating (SIGTERM) 14:05:00.801868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14590): Terminating (SIGTERM) 14:05:00.842619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14593): Terminating (SIGTERM) 14:05:00.884414 --- ParallelTerminationStrategy: PID 14587 died... 14:05:00.904063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14587): Terminated: ok {rc=0} 14:05:00.950558 --- ParallelTerminationStrategy: PID 14590 died... 14:05:00.970195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14590): Terminated: ok {rc=0} 14:05:01.016506 --- ParallelTerminationStrategy: PID 14593 died... 14:05:01.035761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14593): Terminated: ok {rc=0} 14:05:01.123974 bus /sierra_3: Setting Powered False 14:05:02.230174 bus /sierra_3: Setting Powered False 14:05:03.360391 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 14:05:04.626145 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:05:04.632162 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 14:05:04.670257 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 14:05:04.696761 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 14:05:04.750179 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 14:05:04.787140 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 14:05:04.813529 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 14:05:05.361421 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 14:05:05.366551 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:05:05.377293 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 14:05:05.411888 tst handover.py: using LAC 21969 14:05:05.544579 tst handover.py: using RAC 39 14:05:05.671434 tst handover.py: using CellId 21969 14:05:05.800157 tst handover.py: using BVCI 21970 14:05:05.919156 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 14:05:05.955991 tst handover.py: using LAC 21970 14:05:06.083886 tst handover.py: using RAC 40 14:05:06.209401 tst handover.py: using CellId 21970 14:05:06.334676 tst handover.py: using BVCI 21971 14:05:06.453301 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:05:06.464584 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:05:06.475774 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:05:06.487315 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:05:06.498948 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:05:06.510585 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 14:05:06.628631 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 14:05:06.746062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:07.221267 run create_hlr_db(pid=14609): Launched 14:05:07.354274 bus /sierra_2: Setting Powered False 14:05:08.417743 run create_hlr_db(pid=14609): Terminated: ok {rc=0} 14:05:08.824803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14611): Launched 14:05:09.127183 run osmo-hlr_10.42.42.2(pid=14612): Launched 14:05:09.242580 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:09.751674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14614): Launched 14:05:10.054946 run osmo-stp_10.42.42.5(pid=14615): Launched 14:05:10.170802 run osmo-msc_10.42.42.6: Starting osmo-msc 14:05:10.693126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14617): Launched 14:05:10.996859 run osmo-msc_10.42.42.6(pid=14618): Launched 14:05:11.168800 run osmo-stp_10.42.42.5(pid=14615): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14615)] 14:05:11.297395 run osmo-stp_10.42.42.5(pid=14615): stdout: | (launched: 2022-12-09_14:05:09.998595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:11.426883 run osmo-stp_10.42.42.5(pid=14615): stderr: | 20221209140510167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140510167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140510167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140510168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140510168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140510168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140510168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:11.554303 run osmo-stp_10.42.42.5(pid=14615): stdout: | (launched: 2022-12-09_14:05:09.998595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:11.675312 run osmo-stp_10.42.42.5(pid=14615): stderr: | 20221209140510167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140510167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140510167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140510168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140510168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140510168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140510168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:11.819837 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14615): Process ended prematurely: osmo-stp_10.42.42.5(pid=14615) [trial-2360↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14615)] [trial-2360↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 14:05:11.828184 tst handover.py:18: Test FAILED (6.5 sec) 14:05:11.854932 run osmo-hlr_10.42.42.2(pid=14612): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14612)] 14:05:11.902849 run osmo-hlr_10.42.42.2(pid=14612): stdout: | (launched: 2022-12-09_14:05:09.072005) 14:05:11.952391 run osmo-hlr_10.42.42.2(pid=14612): stderr: | 20221209140509246 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140509246 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140509246 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140509246 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140509246 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140509246 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140509259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140509268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140509268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140509268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:12.021373 run osmo-msc_10.42.42.6(pid=14618): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14618)] 14:05:12.069196 run osmo-msc_10.42.42.6(pid=14618): stdout: | (launched: 2022-12-09_14:05:10.941445) 14:05:12.118579 run osmo-msc_10.42.42.6(pid=14618): stderr: | 20221209140511215 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140511215 DLGLOBAL DEBUG validating counter group 0x7faf8b076c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140511215 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140511215 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140511216 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140511216 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140511217 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140511218 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140511218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140511218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:05:12.168232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14611): Terminating (SIGTERM) 14:05:12.207986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14614): Terminating (SIGTERM) 14:05:12.247696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14617): Terminating (SIGTERM) 14:05:12.287648 --- ParallelTerminationStrategy: PID 14611 died... 14:05:12.306712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14611): Terminated: ok {rc=0} 14:05:12.351485 --- ParallelTerminationStrategy: PID 14614 died... 14:05:12.369911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14614): Terminated: ok {rc=0} 14:05:12.413600 --- ParallelTerminationStrategy: PID 14617 died... 14:05:12.432133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14617): Terminated: ok {rc=0} 14:05:12.515095 bus /sierra_3: Setting Powered False 14:05:13.621394 bus /sierra_3: Setting Powered False 14:05:14.739018 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 14:05:15.990689 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:05:15.997087 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 14:05:16.053498 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 14:05:16.082431 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 14:05:16.135701 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 14:05:16.188633 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 14:05:16.217977 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 14:05:16.768654 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 14:05:16.774903 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:05:16.786876 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:05:16.822139 tst handover.py: using LAC 21971 14:05:16.977238 tst handover.py: using RAC 41 14:05:17.134443 tst handover.py: using CellId 21971 14:05:17.281522 tst handover.py: using BVCI 21972 14:05:17.400369 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:05:17.452605 tst handover.py: using LAC 21972 14:05:17.570259 tst handover.py: using RAC 42 14:05:17.690031 tst handover.py: using CellId 21972 14:05:17.809892 tst handover.py: using BVCI 21973 14:05:17.922526 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:05:17.933412 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:05:17.943924 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:05:17.955254 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:05:17.966737 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:05:17.978200 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:05:18.091818 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:05:18.209981 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:18.683998 run create_hlr_db(pid=14974): Launched 14:05:18.815249 bus /sierra_2: Setting Powered False 14:05:19.878767 run create_hlr_db(pid=14974): Terminated: ok {rc=0} 14:05:20.285654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14976): Launched 14:05:20.589284 run osmo-hlr_10.42.42.2(pid=14977): Launched 14:05:20.706250 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:21.217908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14979): Launched 14:05:21.519377 run osmo-stp_10.42.42.5(pid=14980): Launched 14:05:21.636227 run osmo-msc_10.42.42.6: Starting osmo-msc 14:05:22.158983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14982): Launched 14:05:22.462454 run osmo-msc_10.42.42.6(pid=14983): Launched 14:05:22.633659 run osmo-stp_10.42.42.5(pid=14980): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14980)] 14:05:22.763204 run osmo-stp_10.42.42.5(pid=14980): stdout: | (launched: 2022-12-09_14:05:21.464342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:22.902142 run osmo-stp_10.42.42.5(pid=14980): stderr: | 20221209140521634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140521634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140521635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140521635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140521636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140521636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140521636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:23.032897 run osmo-stp_10.42.42.5(pid=14980): stdout: | (launched: 2022-12-09_14:05:21.464342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:23.158629 run osmo-stp_10.42.42.5(pid=14980): stderr: | 20221209140521634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140521634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140521635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140521635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140521636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140521636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140521636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:23.307135 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=14980): Process ended prematurely: osmo-stp_10.42.42.5(pid=14980) [trial-2360↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14980)] [trial-2360↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 14:05:23.316658 tst handover.py:18: Test FAILED (6.5 sec) 14:05:23.346484 run osmo-hlr_10.42.42.2(pid=14977): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14977)] 14:05:23.397217 run osmo-hlr_10.42.42.2(pid=14977): stdout: | (launched: 2022-12-09_14:05:20.533601) 14:05:23.449417 run osmo-hlr_10.42.42.2(pid=14977): stderr: | 20221209140520711 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140520711 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140520711 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140520711 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140520712 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140520712 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140520726 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140520737 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140520737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140520737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:23.520931 run osmo-msc_10.42.42.6(pid=14983): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14983)] 14:05:23.571316 run osmo-msc_10.42.42.6(pid=14983): stdout: | (launched: 2022-12-09_14:05:22.406778) 14:05:23.622957 run osmo-msc_10.42.42.6(pid=14983): stderr: | 20221209140522678 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140522678 DLGLOBAL DEBUG validating counter group 0x7f4f24e24c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140522678 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140522678 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140522678 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140522679 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140522680 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140522681 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140522681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140522681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:05:23.675423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14976): Terminating (SIGTERM) 14:05:23.718525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14979): Terminating (SIGTERM) 14:05:23.762371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14982): Terminating (SIGTERM) 14:05:23.805123 --- ParallelTerminationStrategy: PID 14976 died... 14:05:23.824812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14976): Terminated: ok {rc=0} 14:05:23.872224 --- ParallelTerminationStrategy: PID 14979 died... 14:05:23.892495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14979): Terminated: ok {rc=0} 14:05:23.940140 --- ParallelTerminationStrategy: PID 14982 died... 14:05:23.959575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14982): Terminated: ok {rc=0} 14:05:24.046239 bus /sierra_3: Setting Powered False 14:05:25.144243 bus /sierra_3: Setting Powered False 14:05:26.259474 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 14:05:27.517564 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:05:27.523696 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 14:05:27.574807 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 14:05:27.603676 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 14:05:27.655869 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 14:05:27.706374 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 14:05:27.734517 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 14:05:28.283786 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 14:05:28.290954 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:05:28.303041 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:05:28.342564 tst handover.py: using LAC 21973 14:05:28.493113 tst handover.py: using RAC 43 14:05:28.620345 tst handover.py: using CellId 21973 14:05:28.740060 tst handover.py: using BVCI 21974 14:05:28.850487 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:05:28.893124 tst handover.py: using LAC 21974 14:05:29.010196 tst handover.py: using RAC 44 14:05:29.129721 tst handover.py: using CellId 21974 14:05:29.255328 tst handover.py: using BVCI 21975 14:05:29.367204 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:05:29.378442 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:05:29.389298 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:05:29.400485 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:05:29.411829 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:05:29.423040 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:05:29.536291 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:05:29.651070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:30.094693 run create_hlr_db(pid=15164): Launched 14:05:30.211507 bus /sierra_2: Setting Powered False 14:05:31.276084 run create_hlr_db(pid=15164): Terminated: ok {rc=0} 14:05:31.711024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15166): Launched 14:05:32.056134 run osmo-hlr_10.42.42.2(pid=15167): Launched 14:05:32.229332 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:32.742633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15169): Launched 14:05:33.045495 run osmo-stp_10.42.42.5(pid=15170): Launched 14:05:33.160556 run osmo-msc_10.42.42.6: Starting osmo-msc 14:05:33.682384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15172): Launched 14:05:33.987928 run osmo-msc_10.42.42.6(pid=15173): Launched 14:05:34.156799 run osmo-stp_10.42.42.5(pid=15170): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15170)] 14:05:34.285644 run osmo-stp_10.42.42.5(pid=15170): stdout: | (launched: 2022-12-09_14:05:32.990263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:34.414944 run osmo-stp_10.42.42.5(pid=15170): stderr: | 20221209140533161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140533161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140533162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140533162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140533163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140533163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140533163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:34.542139 run osmo-stp_10.42.42.5(pid=15170): stdout: | (launched: 2022-12-09_14:05:32.990263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:34.663142 run osmo-stp_10.42.42.5(pid=15170): stderr: | 20221209140533161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140533161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140533162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140533162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140533163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140533163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140533163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:34.807304 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15170): Process ended prematurely: osmo-stp_10.42.42.5(pid=15170) [trial-2360↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15170)] [trial-2360↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 14:05:34.815582 tst handover.py:18: Test FAILED (6.5 sec) 14:05:34.842205 run osmo-hlr_10.42.42.2(pid=15167): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15167)] 14:05:34.890078 run osmo-hlr_10.42.42.2(pid=15167): stdout: | (launched: 2022-12-09_14:05:31.992623) 14:05:34.939515 run osmo-hlr_10.42.42.2(pid=15167): stderr: | 20221209140532208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140532208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140532208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140532208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140532208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140532208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140532220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140532228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140532229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140532229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:35.008467 run osmo-msc_10.42.42.6(pid=15173): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15173)] 14:05:35.055986 run osmo-msc_10.42.42.6(pid=15173): stdout: | (launched: 2022-12-09_14:05:33.932252) 14:05:35.105755 run osmo-msc_10.42.42.6(pid=15173): stderr: | 20221209140534205 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140534205 DLGLOBAL DEBUG validating counter group 0x7fcd32b98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140534205 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140534205 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140534205 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140534206 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140534207 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140534208 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140534208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140534208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:05:35.155822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15166): Terminating (SIGTERM) 14:05:35.195637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15169): Terminating (SIGTERM) 14:05:35.236231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15172): Terminating (SIGTERM) 14:05:35.276878 --- ParallelTerminationStrategy: PID 15166 died... 14:05:35.296410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15166): Terminated: ok {rc=0} 14:05:35.340848 --- ParallelTerminationStrategy: PID 15169 died... 14:05:35.359736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15169): Terminated: ok {rc=0} 14:05:35.403741 --- ParallelTerminationStrategy: PID 15172 died... 14:05:35.422250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15172): Terminated: ok {rc=0} 14:05:35.508725 bus /sierra_3: Setting Powered False 14:05:36.607198 bus /sierra_3: Setting Powered False 14:05:37.719184 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:05:38.980673 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:05:38.986265 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:05:39.038324 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:05:39.065685 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:05:39.118966 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:05:39.171396 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:05:39.198646 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:05:39.750832 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:05:39.756253 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:05:39.767766 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:05:39.802594 tst handover.py: using LAC 21975 14:05:39.929509 tst handover.py: using RAC 45 14:05:40.050564 tst handover.py: using CellId 21975 14:05:40.169126 tst handover.py: using BVCI 21976 14:05:40.279496 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:05:40.328422 tst handover.py: using LAC 21976 14:05:40.449344 tst handover.py: using RAC 46 14:05:40.577588 tst handover.py: using CellId 21976 14:05:40.698577 tst handover.py: using BVCI 21977 14:05:40.810280 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:05:40.821297 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:05:40.831957 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:05:40.842925 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:05:40.854035 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:05:40.864804 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:05:40.983157 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:05:41.101500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:41.574502 run create_hlr_db(pid=15179): Launched 14:05:41.708024 bus /sierra_2: Setting Powered False 14:05:42.771990 run create_hlr_db(pid=15179): Terminated: ok {rc=0} 14:05:43.177679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15181): Launched 14:05:43.480245 run osmo-hlr_10.42.42.2(pid=15182): Launched 14:05:43.597225 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:44.108897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15184): Launched 14:05:44.411795 run osmo-stp_10.42.42.5(pid=15185): Launched 14:05:44.527768 run osmo-msc_10.42.42.6: Starting osmo-msc 14:05:45.049314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15187): Launched 14:05:45.352332 run osmo-msc_10.42.42.6(pid=15188): Launched 14:05:45.523013 run osmo-stp_10.42.42.5(pid=15185): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15185)] 14:05:45.651810 run osmo-stp_10.42.42.5(pid=15185): stdout: | (launched: 2022-12-09_14:05:44.356008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:45.780583 run osmo-stp_10.42.42.5(pid=15185): stderr: | 20221209140544527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140544527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140544528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140544528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140544528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140544529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140544529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:45.929447 run osmo-stp_10.42.42.5(pid=15185): stdout: | (launched: 2022-12-09_14:05:44.356008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:46.051893 run osmo-stp_10.42.42.5(pid=15185): stderr: | 20221209140544527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140544527 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140544528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140544528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140544528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140544529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140544529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:46.199101 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15185): Process ended prematurely: osmo-stp_10.42.42.5(pid=15185) [trial-2360↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15185)] [trial-2360↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 14:05:46.207813 tst handover.py:18: Test FAILED (6.4 sec) 14:05:46.235052 run osmo-hlr_10.42.42.2(pid=15182): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15182)] 14:05:46.284277 run osmo-hlr_10.42.42.2(pid=15182): stdout: | (launched: 2022-12-09_14:05:43.425087) 14:05:46.334888 run osmo-hlr_10.42.42.2(pid=15182): stderr: | 20221209140543600 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140543600 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140543600 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140543600 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140543600 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140543600 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140543613 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140543623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140543623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140543623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:46.405584 run osmo-msc_10.42.42.6(pid=15188): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15188)] 14:05:46.454430 run osmo-msc_10.42.42.6(pid=15188): stdout: | (launched: 2022-12-09_14:05:45.297076) 14:05:46.505204 run osmo-msc_10.42.42.6(pid=15188): stderr: | 20221209140545569 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140545569 DLGLOBAL DEBUG validating counter group 0x7f5fe88aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140545569 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140545569 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140545569 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140545569 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140545571 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140545571 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140545572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140545572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:05:46.556389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15181): Terminating (SIGTERM) 14:05:46.597313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15184): Terminating (SIGTERM) 14:05:46.638895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15187): Terminating (SIGTERM) 14:05:46.681729 --- ParallelTerminationStrategy: PID 15181 died... 14:05:46.701152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15181): Terminated: ok {rc=0} 14:05:46.748162 --- ParallelTerminationStrategy: PID 15184 died... 14:05:46.767513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15184): Terminated: ok {rc=0} 14:05:46.812788 --- ParallelTerminationStrategy: PID 15187 died... 14:05:46.831982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15187): Terminated: ok {rc=0} 14:05:46.917814 bus /sierra_3: Setting Powered False 14:05:48.013556 bus /sierra_3: Setting Powered False 14:05:49.129080 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 14:05:50.387998 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:05:50.392789 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:05:50.431196 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:05:50.457844 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:05:50.509838 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:05:50.548897 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:05:50.575394 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:05:51.122634 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 14:05:51.127835 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:05:51.138664 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 14:05:51.172731 tst handover.py: using LAC 21977 14:05:51.291363 tst handover.py: using RAC 47 14:05:51.414993 tst handover.py: using CellId 21977 14:05:51.547268 tst handover.py: using BVCI 21978 14:05:51.659238 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 14:05:51.697565 tst handover.py: using LAC 21978 14:05:51.826542 tst handover.py: using RAC 48 14:05:51.953487 tst handover.py: using CellId 21978 14:05:52.075529 tst handover.py: using BVCI 21979 14:05:52.188061 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:05:52.198984 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:05:52.209714 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:05:52.221170 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:05:52.232709 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:05:52.243970 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 14:05:52.364480 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 14:05:52.483854 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:52.958402 run create_hlr_db(pid=15194): Launched 14:05:53.089710 bus /sierra_2: Setting Powered False 14:05:54.153937 run create_hlr_db(pid=15194): Terminated: ok {rc=0} 14:05:54.577934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15196): Launched 14:05:54.902792 run osmo-hlr_10.42.42.2(pid=15197): Launched 14:05:55.026629 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:55.554900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15199): Launched 14:05:55.878201 run osmo-stp_10.42.42.5(pid=15200): Launched 14:05:56.004212 run osmo-msc_10.42.42.6: Starting osmo-msc 14:05:56.563097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15202): Launched 14:05:56.888860 run osmo-msc_10.42.42.6(pid=15203): Launched 14:05:57.071158 run osmo-stp_10.42.42.5(pid=15200): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15200)] 14:05:57.207642 run osmo-stp_10.42.42.5(pid=15200): stdout: | (launched: 2022-12-09_14:05:55.819451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:57.345092 run osmo-stp_10.42.42.5(pid=15200): stderr: | 20221209140556010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140556010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140556010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140556011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140556011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140556011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140556011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:57.482387 run osmo-stp_10.42.42.5(pid=15200): stdout: | (launched: 2022-12-09_14:05:55.819451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:57.611609 run osmo-stp_10.42.42.5(pid=15200): stderr: | 20221209140556010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140556010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140556010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140556011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140556011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140556011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140556011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:57.765845 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15200): Process ended prematurely: osmo-stp_10.42.42.5(pid=15200) [trial-2360↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15200)] [trial-2360↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 14:05:57.774776 tst handover.py:18: Test FAILED (6.6 sec) 14:05:57.802382 run osmo-hlr_10.42.42.2(pid=15197): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15197)] 14:05:57.852733 run osmo-hlr_10.42.42.2(pid=15197): stdout: | (launched: 2022-12-09_14:05:54.843855) 14:05:57.904373 run osmo-hlr_10.42.42.2(pid=15197): stderr: | 20221209140555041 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140555041 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140555041 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140555041 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140555041 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140555041 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140555053 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140555063 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140555063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140555063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:57.987394 run osmo-msc_10.42.42.6(pid=15203): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15203)] 14:05:58.040140 run osmo-msc_10.42.42.6(pid=15203): stdout: | (launched: 2022-12-09_14:05:56.829845) 14:05:58.091845 run osmo-msc_10.42.42.6(pid=15203): stderr: | 20221209140557152 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140557152 DLGLOBAL DEBUG validating counter group 0x7fc17897ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140557152 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140557152 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140557153 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140557153 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140557154 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140557155 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140557155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140557155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:05:58.143777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15196): Terminating (SIGTERM) 14:05:58.185600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15199): Terminating (SIGTERM) 14:05:58.227469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15202): Terminating (SIGTERM) 14:05:58.269522 --- ParallelTerminationStrategy: PID 15196 died... 14:05:58.289438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15196): Terminated: ok {rc=0} 14:05:58.335573 --- ParallelTerminationStrategy: PID 15199 died... 14:05:58.355130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15199): Terminated: ok {rc=0} 14:05:58.401302 --- ParallelTerminationStrategy: PID 15202 died... 14:05:58.421052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15202): Terminated: ok {rc=0} 14:05:58.509149 bus /sierra_3: Setting Powered False 14:05:59.607592 bus /sierra_3: Setting Powered False 14:06:00.724900 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 14:06:02.003260 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:06:02.009289 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:06:02.062287 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:06:02.090852 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:06:02.146475 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:06:02.203826 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:06:02.232397 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:06:02.780400 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 14:06:02.786018 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:06:02.797375 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:06:02.832125 tst handover.py: using LAC 21979 14:06:02.961185 tst handover.py: using RAC 49 14:06:03.123863 tst handover.py: using CellId 21979 14:06:03.244200 tst handover.py: using BVCI 21980 14:06:03.354724 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:06:03.401931 tst handover.py: using LAC 21980 14:06:03.522716 tst handover.py: using RAC 50 14:06:03.640874 tst handover.py: using CellId 21980 14:06:03.759310 tst handover.py: using BVCI 21981 14:06:03.871149 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:06:03.882128 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:06:03.892678 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:06:03.904261 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:06:03.915707 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:06:03.927015 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:06:04.046727 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:06:04.163683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:06:04.637607 run create_hlr_db(pid=15208): Launched 14:06:04.768927 bus /sierra_2: Setting Powered False 14:06:05.829869 run create_hlr_db(pid=15208): Terminated: ok {rc=0} 14:06:06.227072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15210): Launched 14:06:06.530370 run osmo-hlr_10.42.42.2(pid=15211): Launched 14:06:06.646346 run osmo-stp_10.42.42.5: Starting osmo-stp 14:06:07.144411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15213): Launched 14:06:07.446525 run osmo-stp_10.42.42.5(pid=15214): Launched 14:06:07.563872 run osmo-msc_10.42.42.6: Starting osmo-msc 14:06:08.087397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15216): Launched 14:06:08.390555 run osmo-msc_10.42.42.6(pid=15217): Launched 14:06:08.560381 run osmo-stp_10.42.42.5(pid=15214): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15214)] 14:06:08.688671 run osmo-stp_10.42.42.5(pid=15214): stdout: | (launched: 2022-12-09_14:06:07.391067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:08.817318 run osmo-stp_10.42.42.5(pid=15214): stderr: | 20221209140607561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140607561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140607562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140607562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140607562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140607562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140607563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:08.943821 run osmo-stp_10.42.42.5(pid=15214): stdout: | (launched: 2022-12-09_14:06:07.391067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:09.063675 run osmo-stp_10.42.42.5(pid=15214): stderr: | 20221209140607561 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140607561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140607562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140607562 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140607562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140607562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140607563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:09.207497 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15214): Process ended prematurely: osmo-stp_10.42.42.5(pid=15214) [trial-2360↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15214)] [trial-2360↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 14:06:09.215967 tst handover.py:18: Test FAILED (6.4 sec) 14:06:09.242248 run osmo-hlr_10.42.42.2(pid=15211): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15211)] 14:06:09.290223 run osmo-hlr_10.42.42.2(pid=15211): stdout: | (launched: 2022-12-09_14:06:06.475129) 14:06:09.339531 run osmo-hlr_10.42.42.2(pid=15211): stderr: | 20221209140606650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140606651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140606651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140606651 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140606651 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140606651 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140606665 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140606675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140606675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140606675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:06:09.408639 run osmo-msc_10.42.42.6(pid=15217): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15217)] 14:06:09.456308 run osmo-msc_10.42.42.6(pid=15217): stdout: | (launched: 2022-12-09_14:06:08.334990) 14:06:09.505534 run osmo-msc_10.42.42.6(pid=15217): stderr: | 20221209140608605 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140608605 DLGLOBAL DEBUG validating counter group 0x7f3189061c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140608606 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140608606 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140608606 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140608606 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140608608 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140608608 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140608608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140608608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:06:09.555109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15210): Terminating (SIGTERM) 14:06:09.594940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15213): Terminating (SIGTERM) 14:06:09.634603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15216): Terminating (SIGTERM) 14:06:09.674701 --- ParallelTerminationStrategy: PID 15210 died... 14:06:09.693775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15210): Terminated: ok {rc=0} 14:06:09.737950 --- ParallelTerminationStrategy: PID 15213 died... 14:06:09.756413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15213): Terminated: ok {rc=0} 14:06:09.800427 --- ParallelTerminationStrategy: PID 15216 died... 14:06:09.818876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15216): Terminated: ok {rc=0} 14:06:09.903891 bus /sierra_3: Setting Powered False 14:06:11.002165 bus /sierra_3: Setting Powered False 14:06:12.114179 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 14:06:13.375174 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:06:13.381424 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:06:13.432497 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:06:13.460126 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:06:13.512459 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:06:13.562986 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:06:13.590215 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:06:14.143296 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 14:06:14.148613 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:06:14.159903 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:06:14.195165 tst handover.py: using LAC 21981 14:06:14.323430 tst handover.py: using RAC 51 14:06:14.452191 tst handover.py: using CellId 21981 14:06:14.578383 tst handover.py: using BVCI 21982 14:06:14.697155 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:06:14.747167 tst handover.py: using LAC 21982 14:06:14.874632 tst handover.py: using RAC 52 14:06:15.002559 tst handover.py: using CellId 21982 14:06:15.130880 tst handover.py: using BVCI 21983 14:06:15.249831 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:06:15.261176 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:06:15.272246 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:06:15.283442 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:06:15.294704 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:06:15.305905 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:06:15.425477 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:06:15.544037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:06:16.005971 run create_hlr_db(pid=15222): Launched 14:06:16.199837 bus /sierra_2: Setting Powered False 14:06:17.259007 run create_hlr_db(pid=15222): Terminated: ok {rc=0} 14:06:17.659809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15224): Launched 14:06:17.963493 run osmo-hlr_10.42.42.2(pid=15225): Launched 14:06:18.079666 run osmo-stp_10.42.42.5: Starting osmo-stp 14:06:18.574732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15227): Launched 14:06:18.877076 run osmo-stp_10.42.42.5(pid=15228): Launched 14:06:18.991780 run osmo-msc_10.42.42.6: Starting osmo-msc 14:06:19.512876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15230): Launched 14:06:19.816144 run osmo-msc_10.42.42.6(pid=15231): Launched 14:06:19.986278 run osmo-stp_10.42.42.5(pid=15228): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15228)] 14:06:20.115808 run osmo-stp_10.42.42.5(pid=15228): stdout: | (launched: 2022-12-09_14:06:18.821744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:20.245260 run osmo-stp_10.42.42.5(pid=15228): stderr: | 20221209140618992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140618993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140618993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140618993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140618994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140618994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140618994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:20.371968 run osmo-stp_10.42.42.5(pid=15228): stdout: | (launched: 2022-12-09_14:06:18.821744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:20.492539 run osmo-stp_10.42.42.5(pid=15228): stderr: | 20221209140618992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140618993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140618993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140618993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140618994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140618994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140618994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:20.636703 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15228): Process ended prematurely: osmo-stp_10.42.42.5(pid=15228) [trial-2360↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15228)] [trial-2360↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 14:06:20.645260 tst handover.py:18: Test FAILED (6.5 sec) 14:06:20.672220 run osmo-hlr_10.42.42.2(pid=15225): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15225)] 14:06:20.720195 run osmo-hlr_10.42.42.2(pid=15225): stdout: | (launched: 2022-12-09_14:06:17.908171) 14:06:20.769711 run osmo-hlr_10.42.42.2(pid=15225): stderr: | 20221209140618086 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140618086 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140618086 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140618086 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140618086 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140618086 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140618099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140618109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140618109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140618109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:06:20.839077 run osmo-msc_10.42.42.6(pid=15231): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15231)] 14:06:20.886840 run osmo-msc_10.42.42.6(pid=15231): stdout: | (launched: 2022-12-09_14:06:19.760663) 14:06:20.936214 run osmo-msc_10.42.42.6(pid=15231): stderr: | 20221209140620032 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140620032 DLGLOBAL DEBUG validating counter group 0x7f266de0fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140620032 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140620033 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140620033 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140620033 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140620035 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140620035 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140620035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140620035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:06:20.986016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15224): Terminating (SIGTERM) 14:06:21.025706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15227): Terminating (SIGTERM) 14:06:21.065505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15230): Terminating (SIGTERM) 14:06:21.105518 --- ParallelTerminationStrategy: PID 15224 died... 14:06:21.124598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15224): Terminated: ok {rc=0} 14:06:21.168689 --- ParallelTerminationStrategy: PID 15227 died... 14:06:21.187325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15227): Terminated: ok {rc=0} 14:06:21.231257 --- ParallelTerminationStrategy: PID 15230 died... 14:06:21.249815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15230): Terminated: ok {rc=0} 14:06:21.335789 bus /sierra_3: Setting Powered False 14:06:22.436209 bus /sierra_3: Setting Powered False 14:06:23.551089 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 14:06:24.812007 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:06:24.817141 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 14:06:24.866413 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 14:06:24.892896 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 14:06:24.941969 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 14:06:24.990434 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 14:06:25.017183 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 14:06:25.569594 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 14:06:25.574639 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:06:25.585398 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:06:25.619423 tst handover.py: using LAC 21983 14:06:25.745710 tst handover.py: using RAC 53 14:06:25.865262 tst handover.py: using CellId 21983 14:06:25.982437 tst handover.py: using BVCI 21984 14:06:26.094233 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:06:26.144651 tst handover.py: using LAC 21984 14:06:26.263613 tst handover.py: using RAC 54 14:06:26.381308 tst handover.py: using CellId 21984 14:06:26.498989 tst handover.py: using BVCI 21985 14:06:26.609759 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:06:26.620431 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:06:26.630972 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:06:26.641928 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:06:26.652725 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:06:26.663526 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:06:26.779067 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:06:26.898132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:06:27.370733 run create_hlr_db(pid=15236): Launched 14:06:27.502875 bus /sierra_2: Setting Powered False 14:06:28.563867 run create_hlr_db(pid=15236): Terminated: ok {rc=0} 14:06:28.961264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15238): Launched 14:06:29.265019 run osmo-hlr_10.42.42.2(pid=15239): Launched 14:06:29.381242 run osmo-stp_10.42.42.5: Starting osmo-stp 14:06:29.880667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15241): Launched 14:06:30.184923 run osmo-stp_10.42.42.5(pid=15242): Launched 14:06:30.300445 run osmo-msc_10.42.42.6: Starting osmo-msc 14:06:30.825816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15244): Launched 14:06:31.143406 run osmo-msc_10.42.42.6(pid=15245): Launched 14:06:31.521524 run osmo-stp_10.42.42.5(pid=15242): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15242)] 14:06:31.724758 run osmo-stp_10.42.42.5(pid=15242): stdout: | (launched: 2022-12-09_14:06:30.129331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:31.854954 run osmo-stp_10.42.42.5(pid=15242): stderr: | 20221209140630301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140630302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140630302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140630302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140630303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140630303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140630303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:31.985268 run osmo-stp_10.42.42.5(pid=15242): stdout: | (launched: 2022-12-09_14:06:30.129331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:32.109421 run osmo-stp_10.42.42.5(pid=15242): stderr: | 20221209140630301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140630302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140630302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140630302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140630303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140630303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140630303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:32.257735 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15242): Process ended prematurely: osmo-stp_10.42.42.5(pid=15242) [trial-2360↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15242)] [trial-2360↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 14:06:32.266779 tst handover.py:18: Test FAILED (6.7 sec) 14:06:32.294257 run osmo-hlr_10.42.42.2(pid=15239): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15239)] 14:06:32.344622 run osmo-hlr_10.42.42.2(pid=15239): stdout: | (launched: 2022-12-09_14:06:29.208852) 14:06:32.395920 run osmo-hlr_10.42.42.2(pid=15239): stderr: | 20221209140629384 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140629384 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140629384 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140629384 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140629384 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140629384 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140629397 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140629405 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140629405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140629405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:06:32.467622 run osmo-msc_10.42.42.6(pid=15245): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15245)] 14:06:32.515699 run osmo-msc_10.42.42.6(pid=15245): stdout: | (launched: 2022-12-09_14:06:31.087413) 14:06:32.565231 run osmo-msc_10.42.42.6(pid=15245): stderr: | 20221209140631451 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140631451 DLGLOBAL DEBUG validating counter group 0x7f7ddbaf9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140631451 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140631451 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140631451 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140631451 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140631454 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140631455 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140631455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140631455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:06:32.615467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15238): Terminating (SIGTERM) 14:06:32.655478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15241): Terminating (SIGTERM) 14:06:32.695542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15244): Terminating (SIGTERM) 14:06:32.735758 --- ParallelTerminationStrategy: PID 15238 died... 14:06:32.755017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15238): Terminated: ok {rc=0} 14:06:32.799982 --- ParallelTerminationStrategy: PID 15241 died... 14:06:32.818785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15241): Terminated: ok {rc=0} 14:06:32.863616 --- ParallelTerminationStrategy: PID 15244 died... 14:06:32.882637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15244): Terminated: ok {rc=0} 14:06:32.970159 bus /sierra_3: Setting Powered False 14:06:34.070459 bus /sierra_3: Setting Powered False 14:06:35.186463 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 14:06:36.466191 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:06:36.471761 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 14:06:36.517611 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 14:06:36.545040 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 14:06:36.596485 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 14:06:36.642296 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 14:06:36.669612 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 14:06:37.225371 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 14:06:37.230843 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:06:37.242391 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:06:37.276850 tst handover.py: using LAC 21985 14:06:37.401814 tst handover.py: using RAC 55 14:06:37.526761 tst handover.py: using CellId 21985 14:06:37.651550 tst handover.py: using BVCI 21986 14:06:37.770560 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:06:37.814883 tst handover.py: using LAC 21986 14:06:37.941341 tst handover.py: using RAC 56 14:06:38.066857 tst handover.py: using CellId 21986 14:06:38.192234 tst handover.py: using BVCI 21987 14:06:38.310136 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:06:38.321810 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:06:38.332935 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:06:38.344322 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:06:38.355608 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:06:38.366860 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:06:38.481413 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:06:38.596291 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:06:39.041171 run create_hlr_db(pid=15250): Launched 14:06:39.157662 bus /sierra_2: Setting Powered False 14:06:40.218164 run create_hlr_db(pid=15250): Terminated: ok {rc=0} 14:06:40.616587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15252): Launched 14:06:40.921296 run osmo-hlr_10.42.42.2(pid=15253): Launched 14:06:41.038256 run osmo-stp_10.42.42.5: Starting osmo-stp 14:06:41.547160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15255): Launched 14:06:41.849543 run osmo-stp_10.42.42.5(pid=15256): Launched 14:06:41.965939 run osmo-msc_10.42.42.6: Starting osmo-msc 14:06:42.502866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15258): Launched 14:06:42.805410 run osmo-msc_10.42.42.6(pid=15259): Launched 14:06:42.975166 run osmo-stp_10.42.42.5(pid=15256): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15256)] 14:06:43.103631 run osmo-stp_10.42.42.5(pid=15256): stdout: | (launched: 2022-12-09_14:06:41.794062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:43.232133 run osmo-stp_10.42.42.5(pid=15256): stderr: | 20221209140641965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140641966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140641966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140641966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140641967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140641967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140641967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:43.358302 run osmo-stp_10.42.42.5(pid=15256): stdout: | (launched: 2022-12-09_14:06:41.794062) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:43.478332 run osmo-stp_10.42.42.5(pid=15256): stderr: | 20221209140641965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140641966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140641966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140641966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140641967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140641967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140641967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:43.622407 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15256): Process ended prematurely: osmo-stp_10.42.42.5(pid=15256) [trial-2360↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15256)] [trial-2360↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 14:06:43.630719 tst handover.py:18: Test FAILED (6.4 sec) 14:06:43.657098 run osmo-hlr_10.42.42.2(pid=15253): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15253)] 14:06:43.704441 run osmo-hlr_10.42.42.2(pid=15253): stdout: | (launched: 2022-12-09_14:06:40.865976) 14:06:43.753517 run osmo-hlr_10.42.42.2(pid=15253): stderr: | 20221209140641039 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140641039 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140641039 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140641039 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140641039 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140641039 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140641052 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140641063 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140641063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140641063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:06:43.822244 run osmo-msc_10.42.42.6(pid=15259): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15259)] 14:06:43.869797 run osmo-msc_10.42.42.6(pid=15259): stdout: | (launched: 2022-12-09_14:06:42.750102) 14:06:43.919525 run osmo-msc_10.42.42.6(pid=15259): stderr: | 20221209140643021 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140643021 DLGLOBAL DEBUG validating counter group 0x7f38e5222c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140643021 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140643021 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140643021 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140643022 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140643024 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140643024 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140643024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140643024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:06:43.969137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15252): Terminating (SIGTERM) 14:06:44.008842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15255): Terminating (SIGTERM) 14:06:44.048598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15258): Terminating (SIGTERM) 14:06:44.088427 --- ParallelTerminationStrategy: PID 15252 died... 14:06:44.107448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15252): Terminated: ok {rc=0} 14:06:44.151846 --- ParallelTerminationStrategy: PID 15255 died... 14:06:44.170375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15255): Terminated: ok {rc=0} 14:06:44.214102 --- ParallelTerminationStrategy: PID 15258 died... 14:06:44.232552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15258): Terminated: ok {rc=0} 14:06:44.318675 bus /sierra_3: Setting Powered False 14:06:45.417801 bus /sierra_3: Setting Powered False 14:06:46.530052 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:06:47.783808 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:06:47.789496 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:06:47.841841 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:06:47.869788 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:06:47.923964 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:06:47.975341 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:06:48.003115 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:06:48.554045 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:06:48.559359 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:06:48.570814 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:06:48.606526 tst handover.py: using LAC 21987 14:06:48.735389 tst handover.py: using RAC 57 14:06:48.857046 tst handover.py: using CellId 21987 14:06:48.990020 tst handover.py: using BVCI 21988 14:06:49.110115 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:06:49.159836 tst handover.py: using LAC 21988 14:06:49.279941 tst handover.py: using RAC 58 14:06:49.398055 tst handover.py: using CellId 21988 14:06:49.515339 tst handover.py: using BVCI 21989 14:06:49.625535 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:06:49.636471 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:06:49.647449 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:06:49.658768 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:06:49.670470 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:06:49.681820 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:06:49.800086 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:06:49.920121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:06:50.393743 run create_hlr_db(pid=15264): Launched 14:06:50.519857 bus /sierra_2: Setting Powered False 14:06:51.580514 run create_hlr_db(pid=15264): Terminated: ok {rc=0} 14:06:51.976449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15266): Launched 14:06:52.280042 run osmo-hlr_10.42.42.2(pid=15267): Launched 14:06:52.397386 run osmo-stp_10.42.42.5: Starting osmo-stp 14:06:52.894833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15269): Launched 14:06:53.196890 run osmo-stp_10.42.42.5(pid=15270): Launched 14:06:53.312381 run osmo-msc_10.42.42.6: Starting osmo-msc 14:06:53.833144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15272): Launched 14:06:54.135449 run osmo-msc_10.42.42.6(pid=15273): Launched 14:06:54.305657 run osmo-stp_10.42.42.5(pid=15270): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15270)] 14:06:54.434910 run osmo-stp_10.42.42.5(pid=15270): stdout: | (launched: 2022-12-09_14:06:53.141837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:54.564000 run osmo-stp_10.42.42.5(pid=15270): stderr: | 20221209140653313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140653313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140653314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140653314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140653314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140653315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140653315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:54.690609 run osmo-stp_10.42.42.5(pid=15270): stdout: | (launched: 2022-12-09_14:06:53.141837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:54.811277 run osmo-stp_10.42.42.5(pid=15270): stderr: | 20221209140653313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140653313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140653314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140653314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140653314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140653315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140653315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:54.955151 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15270): Process ended prematurely: osmo-stp_10.42.42.5(pid=15270) [trial-2360↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15270)] [trial-2360↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 14:06:54.963656 tst handover.py:18: Test FAILED (6.4 sec) 14:06:54.989897 run osmo-hlr_10.42.42.2(pid=15267): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15267)] 14:06:55.037932 run osmo-hlr_10.42.42.2(pid=15267): stdout: | (launched: 2022-12-09_14:06:52.224102) 14:06:55.087022 run osmo-hlr_10.42.42.2(pid=15267): stderr: | 20221209140652401 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140652401 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140652401 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140652401 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140652401 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140652401 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140652412 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140652421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140652421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140652421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:06:55.155553 run osmo-msc_10.42.42.6(pid=15273): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15273)] 14:06:55.203744 run osmo-msc_10.42.42.6(pid=15273): stdout: | (launched: 2022-12-09_14:06:54.080044) 14:06:55.253056 run osmo-msc_10.42.42.6(pid=15273): stderr: | 20221209140654352 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140654352 DLGLOBAL DEBUG validating counter group 0x7f6c7ebabc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140654352 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140654352 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140654352 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140654352 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140654354 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140654355 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140654355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140654355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:06:55.302348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15266): Terminating (SIGTERM) 14:06:55.342063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15269): Terminating (SIGTERM) 14:06:55.381643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15272): Terminating (SIGTERM) 14:06:55.421558 --- ParallelTerminationStrategy: PID 15266 died... 14:06:55.440516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15266): Terminated: ok {rc=0} 14:06:55.484723 --- ParallelTerminationStrategy: PID 15269 died... 14:06:55.503358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15269): Terminated: ok {rc=0} 14:06:55.547129 --- ParallelTerminationStrategy: PID 15272 died... 14:06:55.565806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15272): Terminated: ok {rc=0} 14:06:55.649456 bus /sierra_3: Setting Powered False 14:06:56.747299 bus /sierra_3: Setting Powered False 14:06:57.862769 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 14:06:59.128237 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:06:59.133746 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:06:59.171520 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:06:59.199150 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:06:59.251722 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:06:59.289212 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:06:59.316251 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:06:59.868089 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 14:06:59.873490 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:06:59.884675 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 14:06:59.921890 tst handover.py: using LAC 21989 14:07:00.049409 tst handover.py: using RAC 59 14:07:00.180322 tst handover.py: using CellId 21989 14:07:00.308281 tst handover.py: using BVCI 21990 14:07:00.426829 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 14:07:00.461302 tst handover.py: using LAC 21990 14:07:00.580077 tst handover.py: using RAC 60 14:07:00.706514 tst handover.py: using CellId 21990 14:07:00.846805 tst handover.py: using BVCI 21991 14:07:00.979923 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:07:00.991819 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:07:01.004654 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:07:01.016203 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:07:01.028709 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:07:01.042798 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 14:07:01.164128 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 14:07:01.304646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:01.808909 run create_hlr_db(pid=15278): Launched 14:07:01.982349 bus /sierra_2: Setting Powered False 14:07:03.046829 run create_hlr_db(pid=15278): Terminated: ok {rc=0} 14:07:03.468916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15280): Launched 14:07:03.794141 run osmo-hlr_10.42.42.2(pid=15281): Launched 14:07:03.917109 run osmo-stp_10.42.42.5: Starting osmo-stp 14:07:04.449541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15283): Launched 14:07:04.772615 run osmo-stp_10.42.42.5(pid=15284): Launched 14:07:04.895757 run osmo-msc_10.42.42.6: Starting osmo-msc 14:07:05.453813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15286): Launched 14:07:05.778003 run osmo-msc_10.42.42.6(pid=15287): Launched 14:07:05.959975 run osmo-stp_10.42.42.5(pid=15284): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15284)] 14:07:06.096569 run osmo-stp_10.42.42.5(pid=15284): stdout: | (launched: 2022-12-09_14:07:04.713764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:06.233706 run osmo-stp_10.42.42.5(pid=15284): stderr: | 20221209140704906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140704907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140704907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140704907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140704909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140704910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140704910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:06.369921 run osmo-stp_10.42.42.5(pid=15284): stdout: | (launched: 2022-12-09_14:07:04.713764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:06.499748 run osmo-stp_10.42.42.5(pid=15284): stderr: | 20221209140704906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140704907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140704907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140704907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140704909 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140704910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140704910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:06.654057 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15284): Process ended prematurely: osmo-stp_10.42.42.5(pid=15284) [trial-2360↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15284)] [trial-2360↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 14:07:06.663132 tst handover.py:18: Test FAILED (6.8 sec) 14:07:06.690762 run osmo-hlr_10.42.42.2(pid=15281): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15281)] 14:07:06.741346 run osmo-hlr_10.42.42.2(pid=15281): stdout: | (launched: 2022-12-09_14:07:03.735403) 14:07:06.793503 run osmo-hlr_10.42.42.2(pid=15281): stderr: | 20221209140703933 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140703933 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140703933 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140703934 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140703934 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140703934 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140703949 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140703957 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140703957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140703957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:06.865718 run osmo-msc_10.42.42.6(pid=15287): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15287)] 14:07:06.915892 run osmo-msc_10.42.42.6(pid=15287): stdout: | (launched: 2022-12-09_14:07:05.718656) 14:07:06.967585 run osmo-msc_10.42.42.6(pid=15287): stderr: | 20221209140706041 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140706041 DLGLOBAL DEBUG validating counter group 0x7fc191563c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140706041 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140706041 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140706041 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140706042 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140706043 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140706044 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140706044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140706044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:07:07.019474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15280): Terminating (SIGTERM) 14:07:07.061269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15283): Terminating (SIGTERM) 14:07:07.102901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15286): Terminating (SIGTERM) 14:07:07.144808 --- ParallelTerminationStrategy: PID 15280 died... 14:07:07.164510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15280): Terminated: ok {rc=0} 14:07:07.210561 --- ParallelTerminationStrategy: PID 15283 died... 14:07:07.230121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15283): Terminated: ok {rc=0} 14:07:07.276198 --- ParallelTerminationStrategy: PID 15286 died... 14:07:07.295971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15286): Terminated: ok {rc=0} 14:07:07.383196 bus /sierra_3: Setting Powered False 14:07:08.481409 bus /sierra_3: Setting Powered False 14:07:09.597282 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 14:07:10.838969 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:07:10.844505 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:07:10.894719 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:07:10.921986 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:07:10.975954 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:07:11.026147 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:07:11.053488 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:07:11.600645 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 14:07:11.606152 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:07:11.617050 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:07:11.651242 tst handover.py: using LAC 21991 14:07:11.771003 tst handover.py: using RAC 61 14:07:11.892233 tst handover.py: using CellId 21991 14:07:12.012184 tst handover.py: using BVCI 21992 14:07:12.124530 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:07:12.172329 tst handover.py: using LAC 21992 14:07:12.291285 tst handover.py: using RAC 62 14:07:12.412120 tst handover.py: using CellId 21992 14:07:12.533605 tst handover.py: using BVCI 21993 14:07:12.653241 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:07:12.664647 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:07:12.675808 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:07:12.686943 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:07:12.698209 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:07:12.709360 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:07:12.825119 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:07:12.944448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:13.419719 run create_hlr_db(pid=15292): Launched 14:07:13.551663 bus /sierra_2: Setting Powered False 14:07:14.615288 run create_hlr_db(pid=15292): Terminated: ok {rc=0} 14:07:15.022173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15294): Launched 14:07:15.325265 run osmo-hlr_10.42.42.2(pid=15295): Launched 14:07:15.443239 run osmo-stp_10.42.42.5: Starting osmo-stp 14:07:15.986855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15297): Launched 14:07:16.327633 run osmo-stp_10.42.42.5(pid=15298): Launched 14:07:16.565302 run osmo-msc_10.42.42.6: Starting osmo-msc 14:07:17.206023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15300): Launched 14:07:17.531902 run osmo-msc_10.42.42.6(pid=15301): Launched 14:07:17.712252 run osmo-stp_10.42.42.5(pid=15298): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15298)] 14:07:17.850864 run osmo-stp_10.42.42.5(pid=15298): stdout: | (launched: 2022-12-09_14:07:16.268429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:17.988489 run osmo-stp_10.42.42.5(pid=15298): stderr: | 20221209140716564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140716564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140716573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140716573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140716574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140716574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140716574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:18.124706 run osmo-stp_10.42.42.5(pid=15298): stdout: | (launched: 2022-12-09_14:07:16.268429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:18.253552 run osmo-stp_10.42.42.5(pid=15298): stderr: | 20221209140716564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140716564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140716573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140716573 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140716574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140716574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140716574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:18.407503 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15298): Process ended prematurely: osmo-stp_10.42.42.5(pid=15298) [trial-2360↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15298)] [trial-2360↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 14:07:18.416791 tst handover.py:18: Test FAILED (6.8 sec) 14:07:18.444243 run osmo-hlr_10.42.42.2(pid=15295): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15295)] 14:07:18.494491 run osmo-hlr_10.42.42.2(pid=15295): stdout: | (launched: 2022-12-09_14:07:15.270181) 14:07:18.546493 run osmo-hlr_10.42.42.2(pid=15295): stderr: | 20221209140715446 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140715446 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140715446 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140715447 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140715447 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140715447 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140715460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140715470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140715470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140715470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:18.618889 run osmo-msc_10.42.42.6(pid=15301): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15301)] 14:07:18.669114 run osmo-msc_10.42.42.6(pid=15301): stdout: | (launched: 2022-12-09_14:07:17.473085) 14:07:18.720817 run osmo-msc_10.42.42.6(pid=15301): stderr: | 20221209140717796 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140717797 DLGLOBAL DEBUG validating counter group 0x7f09747bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140717797 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140717797 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140717797 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140717797 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140717799 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140717799 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140717799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140717799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:07:18.772849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15294): Terminating (SIGTERM) 14:07:18.814976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15297): Terminating (SIGTERM) 14:07:18.856822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15300): Terminating (SIGTERM) 14:07:18.898765 --- ParallelTerminationStrategy: PID 15294 died... 14:07:18.918680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15294): Terminated: ok {rc=0} 14:07:18.964737 --- ParallelTerminationStrategy: PID 15297 died... 14:07:18.984212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15297): Terminated: ok {rc=0} 14:07:19.030090 --- ParallelTerminationStrategy: PID 15300 died... 14:07:19.049619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15300): Terminated: ok {rc=0} 14:07:19.138749 bus /sierra_3: Setting Powered False 14:07:20.235611 bus /sierra_3: Setting Powered False 14:07:21.351315 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 14:07:22.611979 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:07:22.617078 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:07:22.667094 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:07:22.693537 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:07:22.748160 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:07:22.798232 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:07:22.825704 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:07:23.378450 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 14:07:23.383729 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:07:23.395030 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:07:23.429719 tst handover.py: using LAC 21993 14:07:23.556621 tst handover.py: using RAC 63 14:07:23.684411 tst handover.py: using CellId 21993 14:07:23.809632 tst handover.py: using BVCI 21994 14:07:23.927639 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:07:23.975237 tst handover.py: using LAC 21994 14:07:24.102702 tst handover.py: using RAC 64 14:07:24.230232 tst handover.py: using CellId 21994 14:07:24.357556 tst handover.py: using BVCI 21995 14:07:24.476806 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:07:24.488308 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:07:24.499600 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:07:24.511065 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:07:24.522506 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:07:24.533777 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:07:24.649334 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:07:24.765584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:25.211350 run create_hlr_db(pid=15306): Launched 14:07:25.328551 bus /sierra_2: Setting Powered False 14:07:26.393242 run create_hlr_db(pid=15306): Terminated: ok {rc=0} 14:07:26.818138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15308): Launched 14:07:27.142800 run osmo-hlr_10.42.42.2(pid=15309): Launched 14:07:27.268209 run osmo-stp_10.42.42.5: Starting osmo-stp 14:07:27.798728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15311): Launched 14:07:28.125131 run osmo-stp_10.42.42.5(pid=15312): Launched 14:07:28.249727 run osmo-msc_10.42.42.6: Starting osmo-msc 14:07:28.811345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15314): Launched 14:07:29.137158 run osmo-msc_10.42.42.6(pid=15315): Launched 14:07:29.318549 run osmo-stp_10.42.42.5(pid=15312): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15312)] 14:07:29.455630 run osmo-stp_10.42.42.5(pid=15312): stdout: | (launched: 2022-12-09_14:07:28.065441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:29.593596 run osmo-stp_10.42.42.5(pid=15312): stderr: | 20221209140728257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140728258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140728258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140728259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140728260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140728260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140728260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:29.730124 run osmo-stp_10.42.42.5(pid=15312): stdout: | (launched: 2022-12-09_14:07:28.065441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:29.859612 run osmo-stp_10.42.42.5(pid=15312): stderr: | 20221209140728257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140728258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140728258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140728259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140728260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140728260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140728260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:30.014193 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15312): Process ended prematurely: osmo-stp_10.42.42.5(pid=15312) [trial-2360↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15312)] [trial-2360↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 14:07:30.023263 tst handover.py:18: Test FAILED (6.6 sec) 14:07:30.050803 run osmo-hlr_10.42.42.2(pid=15309): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15309)] 14:07:30.101360 run osmo-hlr_10.42.42.2(pid=15309): stdout: | (launched: 2022-12-09_14:07:27.083786) 14:07:30.152838 run osmo-hlr_10.42.42.2(pid=15309): stderr: | 20221209140727281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140727281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140727281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140727281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140727282 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140727282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140727295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140727304 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140727304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140727304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:30.224898 run osmo-msc_10.42.42.6(pid=15315): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15315)] 14:07:30.274750 run osmo-msc_10.42.42.6(pid=15315): stdout: | (launched: 2022-12-09_14:07:29.077573) 14:07:30.326420 run osmo-msc_10.42.42.6(pid=15315): stderr: | 20221209140729401 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140729401 DLGLOBAL DEBUG validating counter group 0x7fc445688c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140729401 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140729401 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140729401 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140729402 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140729403 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140729404 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140729404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140729404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:07:30.378406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15308): Terminating (SIGTERM) 14:07:30.420508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15311): Terminating (SIGTERM) 14:07:30.462281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15314): Terminating (SIGTERM) 14:07:30.504146 --- ParallelTerminationStrategy: PID 15308 died... 14:07:30.524278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15308): Terminated: ok {rc=0} 14:07:30.570424 --- ParallelTerminationStrategy: PID 15311 died... 14:07:30.589955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15311): Terminated: ok {rc=0} 14:07:30.635884 --- ParallelTerminationStrategy: PID 15314 died... 14:07:30.655649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15314): Terminated: ok {rc=0} 14:07:30.742403 bus /sierra_3: Setting Powered False 14:07:31.841041 bus /sierra_3: Setting Powered False 14:07:32.958284 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 14:07:34.213931 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:07:34.219086 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 14:07:34.278120 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 14:07:34.304692 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 14:07:34.357891 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 14:07:34.417378 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 14:07:34.444323 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 14:07:34.999032 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 14:07:35.004738 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:07:35.016334 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:07:35.065499 tst handover.py: using LAC 21995 14:07:35.194987 tst handover.py: using RAC 65 14:07:35.324471 tst handover.py: using CellId 21995 14:07:35.453387 tst handover.py: using BVCI 21996 14:07:35.571282 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:07:35.617554 tst handover.py: using LAC 21996 14:07:35.738550 tst handover.py: using RAC 66 14:07:35.861826 tst handover.py: using CellId 21996 14:07:35.980847 tst handover.py: using BVCI 21997 14:07:36.090810 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:07:36.101849 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:07:36.112586 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:07:36.123684 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:07:36.134811 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:07:36.145779 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:07:36.263194 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:07:36.382302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:36.857092 run create_hlr_db(pid=15321): Launched 14:07:36.989367 bus /sierra_2: Setting Powered False 14:07:38.052913 run create_hlr_db(pid=15321): Terminated: ok {rc=0} 14:07:38.460423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15323): Launched 14:07:38.764352 run osmo-hlr_10.42.42.2(pid=15324): Launched 14:07:38.880449 run osmo-stp_10.42.42.5: Starting osmo-stp 14:07:39.389495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15326): Launched 14:07:39.692260 run osmo-stp_10.42.42.5(pid=15327): Launched 14:07:39.820618 run osmo-msc_10.42.42.6: Starting osmo-msc 14:07:40.381302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15329): Launched 14:07:40.705977 run osmo-msc_10.42.42.6(pid=15330): Launched 14:07:40.887435 run osmo-stp_10.42.42.5(pid=15327): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15327)] 14:07:41.023886 run osmo-stp_10.42.42.5(pid=15327): stdout: | (launched: 2022-12-09_14:07:39.636625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:41.161238 run osmo-stp_10.42.42.5(pid=15327): stderr: | 20221209140739827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140739827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140739828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140739828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140739828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140739828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140739829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:41.297342 run osmo-stp_10.42.42.5(pid=15327): stdout: | (launched: 2022-12-09_14:07:39.636625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:41.426175 run osmo-stp_10.42.42.5(pid=15327): stderr: | 20221209140739827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140739827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140739828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140739828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140739828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140739828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140739829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:41.580238 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15327): Process ended prematurely: osmo-stp_10.42.42.5(pid=15327) [trial-2360↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15327)] [trial-2360↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 14:07:41.589485 tst handover.py:18: Test FAILED (6.6 sec) 14:07:41.617286 run osmo-hlr_10.42.42.2(pid=15324): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15324)] 14:07:41.667664 run osmo-hlr_10.42.42.2(pid=15324): stdout: | (launched: 2022-12-09_14:07:38.708883) 14:07:41.719746 run osmo-hlr_10.42.42.2(pid=15324): stderr: | 20221209140738888 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140738888 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140738888 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140738888 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140738888 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140738888 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140738901 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140738909 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140738910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140738910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:41.791881 run osmo-msc_10.42.42.6(pid=15330): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15330)] 14:07:41.841780 run osmo-msc_10.42.42.6(pid=15330): stdout: | (launched: 2022-12-09_14:07:40.647056) 14:07:41.893380 run osmo-msc_10.42.42.6(pid=15330): stderr: | 20221209140740970 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140740970 DLGLOBAL DEBUG validating counter group 0x7f87f832ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140740971 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140740971 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140740971 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140740971 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140740973 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140740973 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140740973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140740973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:07:41.945505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15323): Terminating (SIGTERM) 14:07:41.987204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15326): Terminating (SIGTERM) 14:07:42.029043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15329): Terminating (SIGTERM) 14:07:42.071197 --- ParallelTerminationStrategy: PID 15323 died... 14:07:42.091227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15323): Terminated: ok {rc=0} 14:07:42.137605 --- ParallelTerminationStrategy: PID 15326 died... 14:07:42.157355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15326): Terminated: ok {rc=0} 14:07:42.203589 --- ParallelTerminationStrategy: PID 15329 died... 14:07:42.223344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15329): Terminated: ok {rc=0} 14:07:42.309818 bus /sierra_3: Setting Powered False 14:07:43.406366 bus /sierra_3: Setting Powered False 14:07:44.520722 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:07:45.794336 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:07:45.799430 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:07:45.873290 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:07:45.915896 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:07:45.969653 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:07:46.040426 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:07:46.070969 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:07:46.613337 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:07:46.620713 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:07:46.635819 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:07:46.697617 tst handover.py: using LAC 21997 14:07:46.818588 tst handover.py: using RAC 67 14:07:46.955742 tst handover.py: using CellId 21997 14:07:47.083546 tst handover.py: using BVCI 21998 14:07:47.242584 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:07:47.293777 tst handover.py: using LAC 21998 14:07:47.419654 tst handover.py: using RAC 68 14:07:47.547105 tst handover.py: using CellId 21998 14:07:47.672618 tst handover.py: using BVCI 21999 14:07:47.789741 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:07:47.801581 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:07:47.813254 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:07:47.824677 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:07:47.836100 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:07:47.847569 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:07:47.964135 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:07:48.086013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:48.561556 run create_hlr_db(pid=15335): Launched 14:07:48.695179 bus /sierra_2: Setting Powered False 14:07:49.758837 run create_hlr_db(pid=15335): Terminated: ok {rc=0} 14:07:50.181981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15337): Launched 14:07:50.509000 run osmo-hlr_10.42.42.2(pid=15338): Launched 14:07:50.636171 run osmo-stp_10.42.42.5: Starting osmo-stp 14:07:51.165470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15340): Launched 14:07:51.489669 run osmo-stp_10.42.42.5(pid=15341): Launched 14:07:51.615264 run osmo-msc_10.42.42.6: Starting osmo-msc 14:07:52.172786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15343): Launched 14:07:52.497196 run osmo-msc_10.42.42.6(pid=15344): Launched 14:07:52.678267 run osmo-stp_10.42.42.5(pid=15341): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15341)] 14:07:52.814596 run osmo-stp_10.42.42.5(pid=15341): stdout: | (launched: 2022-12-09_14:07:51.430700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:52.952017 run osmo-stp_10.42.42.5(pid=15341): stderr: | 20221209140751624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140751624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140751624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140751625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140751627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140751627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140751627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:53.088582 run osmo-stp_10.42.42.5(pid=15341): stdout: | (launched: 2022-12-09_14:07:51.430700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:53.217326 run osmo-stp_10.42.42.5(pid=15341): stderr: | 20221209140751624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140751624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140751624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140751625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140751627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140751627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140751627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:53.371512 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15341): Process ended prematurely: osmo-stp_10.42.42.5(pid=15341) [trial-2360↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15341)] [trial-2360↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 14:07:53.380320 tst handover.py:18: Test FAILED (6.8 sec) 14:07:53.407796 run osmo-hlr_10.42.42.2(pid=15338): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15338)] 14:07:53.458167 run osmo-hlr_10.42.42.2(pid=15338): stdout: | (launched: 2022-12-09_14:07:50.449929) 14:07:53.510169 run osmo-hlr_10.42.42.2(pid=15338): stderr: | 20221209140750650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140750651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140750651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140750651 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140750651 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140750651 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140750664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140750672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140750672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140750672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:53.582480 run osmo-msc_10.42.42.6(pid=15344): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15344)] 14:07:53.633148 run osmo-msc_10.42.42.6(pid=15344): stdout: | (launched: 2022-12-09_14:07:52.438017) 14:07:53.685242 run osmo-msc_10.42.42.6(pid=15344): stderr: | 20221209140752760 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140752760 DLGLOBAL DEBUG validating counter group 0x7f282e3e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140752761 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140752761 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140752761 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140752761 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140752763 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140752763 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140752763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140752763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:07:53.737463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15337): Terminating (SIGTERM) 14:07:53.779377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15340): Terminating (SIGTERM) 14:07:53.821441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15343): Terminating (SIGTERM) 14:07:53.863560 --- ParallelTerminationStrategy: PID 15337 died... 14:07:53.883316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15337): Terminated: ok {rc=0} 14:07:53.929537 --- ParallelTerminationStrategy: PID 15340 died... 14:07:53.949205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15340): Terminated: ok {rc=0} 14:07:53.995538 --- ParallelTerminationStrategy: PID 15343 died... 14:07:54.015205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15343): Terminated: ok {rc=0} 14:07:54.103474 bus /sierra_3: Setting Powered False 14:07:55.204738 bus /sierra_3: Setting Powered False 14:07:56.321724 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 14:07:57.599380 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:07:57.604857 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:07:57.657541 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:07:57.685173 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:07:57.738971 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:07:57.791150 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:07:57.818446 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:07:58.368387 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 14:07:58.373695 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:07:58.384900 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 14:07:58.432919 tst handover.py: using LAC 21999 14:07:58.560728 tst handover.py: using RAC 69 14:07:58.689662 tst handover.py: using CellId 21999 14:07:58.815644 tst handover.py: using BVCI 22000 14:07:58.935489 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 14:07:58.969461 tst handover.py: using LAC 22000 14:07:59.087449 tst handover.py: using RAC 70 14:07:59.205097 tst handover.py: using CellId 22000 14:07:59.322293 tst handover.py: using BVCI 22001 14:07:59.434126 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:07:59.445190 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:07:59.456039 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:07:59.466983 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:07:59.478133 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:07:59.489194 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 14:07:59.606553 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 14:07:59.725404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:08:00.198993 run create_hlr_db(pid=15349): Launched 14:08:00.330112 bus /sierra_2: Setting Powered False 14:08:01.389912 run create_hlr_db(pid=15349): Terminated: ok {rc=0} 14:08:01.821088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15360): Launched 14:08:02.191003 run osmo-hlr_10.42.42.2(pid=15380): Launched 14:08:02.448515 run osmo-stp_10.42.42.5: Starting osmo-stp 14:08:03.259023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15432): Launched 14:08:03.669723 run osmo-stp_10.42.42.5(pid=15483): Launched 14:08:03.933473 run osmo-msc_10.42.42.6: Starting osmo-msc 14:08:04.748628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15621): Launched 14:08:05.117678 run osmo-msc_10.42.42.6(pid=15628): Launched 14:08:05.473767 run osmo-stp_10.42.42.5(pid=15483): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15483)] 14:08:05.754869 run osmo-stp_10.42.42.5(pid=15483): stdout: | (launched: 2022-12-09_14:08:03.593202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:06.029682 run osmo-stp_10.42.42.5(pid=15483): stderr: | 20221209140803955 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140803955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140803956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140803956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140803956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140803963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140803963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:06.201688 run osmo-stp_10.42.42.5(pid=15483): stdout: | (launched: 2022-12-09_14:08:03.593202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:06.328204 run osmo-stp_10.42.42.5(pid=15483): stderr: | 20221209140803955 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140803955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140803956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140803956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140803956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140803963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140803963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:06.478637 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15483): Process ended prematurely: osmo-stp_10.42.42.5(pid=15483) [trial-2360↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15483)] [trial-2360↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 14:08:06.488044 tst handover.py:18: Test FAILED (8.1 sec) 14:08:06.517643 run osmo-hlr_10.42.42.2(pid=15380): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15380)] 14:08:06.568663 run osmo-hlr_10.42.42.2(pid=15380): stdout: | (launched: 2022-12-09_14:08:02.122783) 14:08:06.620905 run osmo-hlr_10.42.42.2(pid=15380): stderr: | 20221209140802497 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140802497 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140802497 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140802497 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140802497 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140802497 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140802511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140802524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140802529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140802529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:08:06.694715 run osmo-msc_10.42.42.6(pid=15628): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15628)] 14:08:06.744782 run osmo-msc_10.42.42.6(pid=15628): stdout: | (launched: 2022-12-09_14:08:05.056361) 14:08:06.797310 run osmo-msc_10.42.42.6(pid=15628): stderr: | 20221209140805647 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140805648 DLGLOBAL DEBUG validating counter group 0x7fa4155bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140805648 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140805648 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140805648 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140805648 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140805658 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140805659 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140805659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140805659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:08:06.851285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15360): Terminating (SIGTERM) 14:08:06.895248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15432): Terminating (SIGTERM) 14:08:06.940192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15621): Terminating (SIGTERM) 14:08:06.984516 --- ParallelTerminationStrategy: PID 15360 died... 14:08:07.004568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15360): Terminated: ok {rc=0} 14:08:07.053525 --- ParallelTerminationStrategy: PID 15432 died... 14:08:07.074672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15432): Terminated: ok {rc=0} 14:08:07.122182 --- ParallelTerminationStrategy: PID 15621 died... 14:08:07.141835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15621): Terminated: ok {rc=0} 14:08:07.230567 bus /sierra_3: Setting Powered False 14:08:08.331204 bus /sierra_3: Setting Powered False 14:08:09.447802 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 14:08:10.709226 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:08:10.715424 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:08:10.783047 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:08:10.811823 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:08:10.865285 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:08:10.931229 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:08:10.960600 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:08:11.507589 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 14:08:11.514500 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:08:11.526809 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:08:11.580420 tst handover.py: using LAC 22001 14:08:11.706804 tst handover.py: using RAC 71 14:08:11.830190 tst handover.py: using CellId 22001 14:08:11.953679 tst handover.py: using BVCI 22002 14:08:12.067487 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:08:12.118320 tst handover.py: using LAC 22002 14:08:12.242481 tst handover.py: using RAC 72 14:08:12.368412 tst handover.py: using CellId 22002 14:08:12.492370 tst handover.py: using BVCI 22003 14:08:12.607510 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:08:12.619497 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:08:12.631719 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:08:12.645806 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:08:12.658709 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:08:12.672051 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:08:12.792673 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:08:12.913048 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:08:13.375551 run create_hlr_db(pid=15635): Launched 14:08:13.536617 bus /sierra_2: Setting Powered False 14:08:14.598636 run create_hlr_db(pid=15635): Terminated: ok {rc=0} 14:08:15.012875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15637): Launched 14:08:15.341065 run osmo-hlr_10.42.42.2(pid=15638): Launched 14:08:15.575121 run osmo-stp_10.42.42.5: Starting osmo-stp 14:08:16.326483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15640): Launched 14:08:16.671889 run osmo-stp_10.42.42.5(pid=15641): Launched 14:08:16.829142 run osmo-msc_10.42.42.6: Starting osmo-msc 14:08:17.601672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15643): Launched 14:08:18.028041 run osmo-msc_10.42.42.6(pid=15644): Launched 14:08:18.455766 run osmo-stp_10.42.42.5(pid=15641): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15641)] 14:08:18.692073 run osmo-stp_10.42.42.5(pid=15641): stdout: | (launched: 2022-12-09_14:08:16.612531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:18.886108 run osmo-stp_10.42.42.5(pid=15641): stderr: | 20221209140816952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140816952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140816952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140816961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140816962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140816962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140816962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:19.017783 run osmo-stp_10.42.42.5(pid=15641): stdout: | (launched: 2022-12-09_14:08:16.612531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:19.143410 run osmo-stp_10.42.42.5(pid=15641): stderr: | 20221209140816952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140816952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140816952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140816961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140816962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140816962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140816962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:19.295144 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15641): Process ended prematurely: osmo-stp_10.42.42.5(pid=15641) [trial-2360↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15641)] [trial-2360↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 14:08:19.303687 tst handover.py:18: Test FAILED (7.8 sec) 14:08:19.332209 run osmo-hlr_10.42.42.2(pid=15638): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15638)] 14:08:19.382903 run osmo-hlr_10.42.42.2(pid=15638): stdout: | (launched: 2022-12-09_14:08:15.281335) 14:08:19.434990 run osmo-hlr_10.42.42.2(pid=15638): stderr: | 20221209140815626 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140815626 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140815626 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140815626 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140815626 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140815626 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140815646 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140815661 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140815661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140815661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:08:19.507619 run osmo-msc_10.42.42.6(pid=15644): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15644)] 14:08:19.558038 run osmo-msc_10.42.42.6(pid=15644): stdout: | (launched: 2022-12-09_14:08:17.956895) 14:08:19.609552 run osmo-msc_10.42.42.6(pid=15644): stderr: | 20221209140818446 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140818446 DLGLOBAL DEBUG validating counter group 0x7fdf8d79cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140818446 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140818446 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140818446 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140818446 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140818448 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140818457 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140818457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140818457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:08:19.661273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15637): Terminating (SIGTERM) 14:08:19.705859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15640): Terminating (SIGTERM) 14:08:19.751162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15643): Terminating (SIGTERM) 14:08:19.796181 --- ParallelTerminationStrategy: PID 15637 died... 14:08:19.817502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15637): Terminated: ok {rc=0} 14:08:19.867889 --- ParallelTerminationStrategy: PID 15640 died... 14:08:19.888790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15640): Terminated: ok {rc=0} 14:08:19.936909 --- ParallelTerminationStrategy: PID 15643 died... 14:08:19.956767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15643): Terminated: ok {rc=0} 14:08:20.046297 bus /sierra_3: Setting Powered False 14:08:21.149662 bus /sierra_3: Setting Powered False 14:08:22.268418 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 14:08:23.553959 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:08:23.560774 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:08:23.627606 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:08:23.656649 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:08:23.711411 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:08:23.779444 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:08:23.808867 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:08:24.357838 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 14:08:24.364837 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:08:24.377516 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:08:24.433369 tst handover.py: using LAC 22003 14:08:24.565061 tst handover.py: using RAC 73 14:08:24.695304 tst handover.py: using CellId 22003 14:08:24.827510 tst handover.py: using BVCI 22004 14:08:24.953736 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:08:25.001757 tst handover.py: using LAC 22004 14:08:25.132062 tst handover.py: using RAC 74 14:08:25.260586 tst handover.py: using CellId 22004 14:08:25.390496 tst handover.py: using BVCI 22005 14:08:25.513807 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:08:25.526171 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:08:25.538653 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:08:25.551429 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:08:25.564530 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:08:25.576515 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:08:25.693814 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:08:25.809793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:08:26.254760 run create_hlr_db(pid=15649): Launched 14:08:26.371568 bus /sierra_2: Setting Powered False 14:08:27.431532 run create_hlr_db(pid=15649): Terminated: ok {rc=0} 14:08:27.847882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15651): Launched 14:08:28.171905 run osmo-hlr_10.42.42.2(pid=15652): Launched 14:08:28.295469 run osmo-stp_10.42.42.5: Starting osmo-stp 14:08:28.826501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15654): Launched 14:08:29.151839 run osmo-stp_10.42.42.5(pid=15655): Launched 14:08:29.275285 run osmo-msc_10.42.42.6: Starting osmo-msc 14:08:29.833282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15657): Launched 14:08:30.158207 run osmo-msc_10.42.42.6(pid=15658): Launched 14:08:30.341655 run osmo-stp_10.42.42.5(pid=15655): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15655)] 14:08:30.471668 run osmo-stp_10.42.42.5(pid=15655): stdout: | (launched: 2022-12-09_14:08:29.092283) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:30.603045 run osmo-stp_10.42.42.5(pid=15655): stderr: | 20221209140829283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140829283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140829284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140829285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140829285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140829285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140829286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:30.730183 run osmo-stp_10.42.42.5(pid=15655): stdout: | (launched: 2022-12-09_14:08:29.092283) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:30.859369 run osmo-stp_10.42.42.5(pid=15655): stderr: | 20221209140829283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140829283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140829284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140829285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140829285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140829285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140829286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:31.015714 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15655): Process ended prematurely: osmo-stp_10.42.42.5(pid=15655) [trial-2360↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15655)] [trial-2360↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 14:08:31.025061 tst handover.py:18: Test FAILED (6.7 sec) 14:08:31.054796 run osmo-hlr_10.42.42.2(pid=15652): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15652)] 14:08:31.105634 run osmo-hlr_10.42.42.2(pid=15652): stdout: | (launched: 2022-12-09_14:08:28.113255) 14:08:31.158566 run osmo-hlr_10.42.42.2(pid=15652): stderr: | 20221209140828317 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140828317 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140828317 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140828317 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140828317 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140828317 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140828333 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140828344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140828344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140828344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:08:31.230631 run osmo-msc_10.42.42.6(pid=15658): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15658)] 14:08:31.281168 run osmo-msc_10.42.42.6(pid=15658): stdout: | (launched: 2022-12-09_14:08:30.099194) 14:08:31.333180 run osmo-msc_10.42.42.6(pid=15658): stderr: | 20221209140830402 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140830402 DLGLOBAL DEBUG validating counter group 0x7fbfa77e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140830402 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140830402 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140830402 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140830402 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140830404 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140830404 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140830405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140830405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:08:31.385784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15651): Terminating (SIGTERM) 14:08:31.428645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15654): Terminating (SIGTERM) 14:08:31.472647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15657): Terminating (SIGTERM) 14:08:31.517878 --- ParallelTerminationStrategy: PID 15651 died... 14:08:31.538050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15651): Terminated: ok {rc=0} 14:08:31.587397 --- ParallelTerminationStrategy: PID 15654 died... 14:08:31.607095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15654): Terminated: ok {rc=0} 14:08:31.655446 --- ParallelTerminationStrategy: PID 15657 died... 14:08:31.675466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15657): Terminated: ok {rc=0} 14:08:31.771316 bus /sierra_3: Setting Powered False 14:08:32.884352 bus /sierra_3: Setting Powered False 14:08:33.997458 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:08:35.267434 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:08:35.272445 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:08:35.331718 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:08:35.358422 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:08:35.409503 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:08:35.472044 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:08:35.499630 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:08:36.053238 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:08:36.058783 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:08:36.070696 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:08:36.115686 tst handover.py: using LAC 22005 14:08:36.243691 tst handover.py: using RAC 75 14:08:36.363876 tst handover.py: using CellId 22005 14:08:36.484755 tst handover.py: using BVCI 22006 14:08:36.597583 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:08:36.646294 tst handover.py: using LAC 22006 14:08:36.766796 tst handover.py: using RAC 76 14:08:36.886677 tst handover.py: using CellId 22006 14:08:37.019771 tst handover.py: using BVCI 22007 14:08:37.138190 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:08:37.150048 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:08:37.161849 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:08:37.173615 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:08:37.185424 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:08:37.196858 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:08:37.312336 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:08:37.431734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:08:37.906325 run create_hlr_db(pid=15663): Launched 14:08:38.037356 bus /sierra_2: Setting Powered False 14:08:39.101737 run create_hlr_db(pid=15663): Terminated: ok {rc=0} 14:08:39.525221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15665): Launched 14:08:39.848717 run osmo-hlr_10.42.42.2(pid=15666): Launched 14:08:39.975195 run osmo-stp_10.42.42.5: Starting osmo-stp 14:08:40.504258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15668): Launched 14:08:40.827048 run osmo-stp_10.42.42.5(pid=15669): Launched 14:08:40.951295 run osmo-msc_10.42.42.6: Starting osmo-msc 14:08:41.516135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15671): Launched 14:08:41.841169 run osmo-msc_10.42.42.6(pid=15672): Launched 14:08:42.023388 run osmo-stp_10.42.42.5(pid=15669): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15669)] 14:08:42.160221 run osmo-stp_10.42.42.5(pid=15669): stdout: | (launched: 2022-12-09_14:08:40.768257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:42.297481 run osmo-stp_10.42.42.5(pid=15669): stderr: | 20221209140840960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140840960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140840960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140840961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140840963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140840963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140840963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:42.434242 run osmo-stp_10.42.42.5(pid=15669): stdout: | (launched: 2022-12-09_14:08:40.768257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:42.564246 run osmo-stp_10.42.42.5(pid=15669): stderr: | 20221209140840960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140840960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140840960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140840961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140840963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140840963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140840963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:42.718629 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15669): Process ended prematurely: osmo-stp_10.42.42.5(pid=15669) [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15669)] [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 14:08:42.727493 tst handover.py:18: Test FAILED (6.7 sec) 14:08:42.755110 run osmo-hlr_10.42.42.2(pid=15666): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15666)] 14:08:42.805934 run osmo-hlr_10.42.42.2(pid=15666): stdout: | (launched: 2022-12-09_14:08:39.789961) 14:08:42.858123 run osmo-hlr_10.42.42.2(pid=15666): stderr: | 20221209140839989 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140839989 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140839989 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140839989 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140839989 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140839989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140840002 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140840010 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140840011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140840011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:08:42.930809 run osmo-msc_10.42.42.6(pid=15672): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15672)] 14:08:42.981382 run osmo-msc_10.42.42.6(pid=15672): stdout: | (launched: 2022-12-09_14:08:41.781979) 14:08:43.033501 run osmo-msc_10.42.42.6(pid=15672): stderr: | 20221209140842107 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140842107 DLGLOBAL DEBUG validating counter group 0x7efe311f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140842107 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140842107 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140842108 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140842108 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140842109 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140842110 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140842110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140842110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:08:43.086171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15665): Terminating (SIGTERM) 14:08:43.128293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15668): Terminating (SIGTERM) 14:08:43.170558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15671): Terminating (SIGTERM) 14:08:43.213318 --- ParallelTerminationStrategy: PID 15665 died... 14:08:43.233799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15665): Terminated: ok {rc=0} 14:08:43.280342 --- ParallelTerminationStrategy: PID 15668 died... 14:08:43.300231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15668): Terminated: ok {rc=0} 14:08:43.346725 --- ParallelTerminationStrategy: PID 15671 died... 14:08:43.366449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15671): Terminated: ok {rc=0} 14:08:43.454604 bus /sierra_3: Setting Powered False 14:08:44.554361 bus /sierra_3: Setting Powered False 14:08:45.670849 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 14:08:46.946387 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:08:46.954120 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:08:47.015242 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:08:47.049911 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:08:47.109125 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:08:47.164887 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:08:47.193026 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:08:47.733548 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 14:08:47.738654 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:08:47.749789 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 14:08:47.794936 tst handover.py: using LAC 22007 14:08:47.914789 tst handover.py: using RAC 77 14:08:48.033631 tst handover.py: using CellId 22007 14:08:48.161596 tst handover.py: using BVCI 22008 14:08:48.278601 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 14:08:48.313294 tst handover.py: using LAC 22008 14:08:48.437970 tst handover.py: using RAC 78 14:08:48.563348 tst handover.py: using CellId 22008 14:08:48.688811 tst handover.py: using BVCI 22009 14:08:48.807880 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:08:48.819260 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:08:48.830443 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:08:48.842317 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:08:48.854222 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:08:48.865938 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 14:08:48.981916 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 14:08:49.096355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:08:49.542031 run create_hlr_db(pid=15677): Launched 14:08:49.659344 bus /sierra_2: Setting Powered False 14:08:50.719240 run create_hlr_db(pid=15677): Terminated: ok {rc=0} 14:08:51.134587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15679): Launched 14:08:51.462941 run osmo-hlr_10.42.42.2(pid=15680): Launched 14:08:51.587982 run osmo-stp_10.42.42.5: Starting osmo-stp 14:08:52.118208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15682): Launched 14:08:52.443249 run osmo-stp_10.42.42.5(pid=15683): Launched 14:08:52.569817 run osmo-msc_10.42.42.6: Starting osmo-msc 14:08:53.127869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15685): Launched 14:08:53.452867 run osmo-msc_10.42.42.6(pid=15686): Launched 14:08:53.634506 run osmo-stp_10.42.42.5(pid=15683): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15683)] 14:08:53.771556 run osmo-stp_10.42.42.5(pid=15683): stdout: | (launched: 2022-12-09_14:08:52.384066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:53.908711 run osmo-stp_10.42.42.5(pid=15683): stderr: | 20221209140852577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140852577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140852577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140852578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140852579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140852579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140852579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:54.045194 run osmo-stp_10.42.42.5(pid=15683): stdout: | (launched: 2022-12-09_14:08:52.384066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:54.174174 run osmo-stp_10.42.42.5(pid=15683): stderr: | 20221209140852577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140852577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140852577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140852578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140852579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140852579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140852579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:54.327835 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15683): Process ended prematurely: osmo-stp_10.42.42.5(pid=15683) [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15683)] [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 14:08:54.336678 tst handover.py:18: Test FAILED (6.6 sec) 14:08:54.364318 run osmo-hlr_10.42.42.2(pid=15680): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15680)] 14:08:54.415082 run osmo-hlr_10.42.42.2(pid=15680): stdout: | (launched: 2022-12-09_14:08:51.403501) 14:08:54.467651 run osmo-hlr_10.42.42.2(pid=15680): stderr: | 20221209140851604 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140851604 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140851604 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140851604 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140851604 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140851604 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140851616 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140851625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140851625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140851625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:08:54.540874 run osmo-msc_10.42.42.6(pid=15686): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15686)] 14:08:54.591302 run osmo-msc_10.42.42.6(pid=15686): stdout: | (launched: 2022-12-09_14:08:53.393344) 14:08:54.643414 run osmo-msc_10.42.42.6(pid=15686): stderr: | 20221209140853718 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140853718 DLGLOBAL DEBUG validating counter group 0x7f4e80f21c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140853719 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140853719 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140853719 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140853719 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140853721 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140853721 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140853721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140853721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:08:54.696239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15679): Terminating (SIGTERM) 14:08:54.738435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15682): Terminating (SIGTERM) 14:08:54.780483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15685): Terminating (SIGTERM) 14:08:54.822784 --- ParallelTerminationStrategy: PID 15679 died... 14:08:54.842938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15679): Terminated: ok {rc=0} 14:08:54.889197 --- ParallelTerminationStrategy: PID 15682 died... 14:08:54.909036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15682): Terminated: ok {rc=0} 14:08:54.955437 --- ParallelTerminationStrategy: PID 15685 died... 14:08:54.975196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15685): Terminated: ok {rc=0} 14:08:55.063393 bus /sierra_3: Setting Powered False 14:08:56.163466 bus /sierra_3: Setting Powered False 14:08:57.279234 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 14:08:58.536108 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:08:58.542221 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:08:58.601645 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:08:58.628927 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:08:58.682516 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:08:58.743636 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:08:58.770786 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:08:59.323554 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 14:08:59.328815 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:08:59.340545 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:08:59.385906 tst handover.py: using LAC 22009 14:08:59.514268 tst handover.py: using RAC 79 14:08:59.641872 tst handover.py: using CellId 22009 14:08:59.769698 tst handover.py: using BVCI 22010 14:08:59.881222 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:08:59.929419 tst handover.py: using LAC 22010 14:09:00.049838 tst handover.py: using RAC 80 14:09:00.169480 tst handover.py: using CellId 22010 14:09:00.297092 tst handover.py: using BVCI 22011 14:09:00.414313 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:00.426056 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:00.437507 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:00.449054 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:00.460892 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:00.472238 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:09:00.586312 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:09:00.700592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:09:01.189325 run create_hlr_db(pid=15691): Launched 14:09:01.355730 bus /sierra_2: Setting Powered False 14:09:02.418172 run create_hlr_db(pid=15691): Terminated: ok {rc=0} 14:09:02.841665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15693): Launched 14:09:03.167106 run osmo-hlr_10.42.42.2(pid=15694): Launched 14:09:03.290093 run osmo-stp_10.42.42.5: Starting osmo-stp 14:09:03.822701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15696): Launched 14:09:04.147393 run osmo-stp_10.42.42.5(pid=15697): Launched 14:09:04.270757 run osmo-msc_10.42.42.6: Starting osmo-msc 14:09:04.828431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15699): Launched 14:09:05.152069 run osmo-msc_10.42.42.6(pid=15700): Launched 14:09:05.331737 run osmo-stp_10.42.42.5(pid=15697): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15697)] 14:09:05.469390 run osmo-stp_10.42.42.5(pid=15697): stdout: | (launched: 2022-12-09_14:09:04.088277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:05.606884 run osmo-stp_10.42.42.5(pid=15697): stderr: | 20221209140904280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140904280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140904281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140904281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140904284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140904284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140904284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:05.742915 run osmo-stp_10.42.42.5(pid=15697): stdout: | (launched: 2022-12-09_14:09:04.088277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:05.870986 run osmo-stp_10.42.42.5(pid=15697): stderr: | 20221209140904280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140904280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140904281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140904281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140904284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140904284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140904284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:06.024322 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15697): Process ended prematurely: osmo-stp_10.42.42.5(pid=15697) [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15697)] [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 14:09:06.033258 tst handover.py:18: Test FAILED (6.7 sec) 14:09:06.060490 run osmo-hlr_10.42.42.2(pid=15694): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15694)] 14:09:06.110537 run osmo-hlr_10.42.42.2(pid=15694): stdout: | (launched: 2022-12-09_14:09:03.108020) 14:09:06.162469 run osmo-hlr_10.42.42.2(pid=15694): stderr: | 20221209140903308 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140903308 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140903308 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140903309 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140903309 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140903309 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140903321 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140903330 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140903330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140903330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:09:06.235078 run osmo-msc_10.42.42.6(pid=15700): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15700)] 14:09:06.285124 run osmo-msc_10.42.42.6(pid=15700): stdout: | (launched: 2022-12-09_14:09:05.093152) 14:09:06.336772 run osmo-msc_10.42.42.6(pid=15700): stderr: | 20221209140905415 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140905416 DLGLOBAL DEBUG validating counter group 0x7f6271066c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140905416 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140905416 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140905416 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140905416 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140905420 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140905420 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140905420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140905420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:09:06.388719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15693): Terminating (SIGTERM) 14:09:06.430366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15696): Terminating (SIGTERM) 14:09:06.472340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15699): Terminating (SIGTERM) 14:09:06.514389 --- ParallelTerminationStrategy: PID 15693 died... 14:09:06.534410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15693): Terminated: ok {rc=0} 14:09:06.580498 --- ParallelTerminationStrategy: PID 15696 died... 14:09:06.600048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15696): Terminated: ok {rc=0} 14:09:06.646242 --- ParallelTerminationStrategy: PID 15699 died... 14:09:06.665916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15699): Terminated: ok {rc=0} 14:09:06.753318 bus /sierra_3: Setting Powered False 14:09:07.852595 bus /sierra_3: Setting Powered False 14:09:08.968806 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 14:09:10.243156 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:09:10.248662 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:09:10.308195 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:09:10.335705 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:09:10.390111 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:09:10.449430 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:09:10.476760 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:09:11.029987 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 14:09:11.035942 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:09:11.047224 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:09:11.094990 tst handover.py: using LAC 22011 14:09:11.214213 tst handover.py: using RAC 81 14:09:11.332650 tst handover.py: using CellId 22011 14:09:11.459649 tst handover.py: using BVCI 22012 14:09:11.577609 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:09:11.625473 tst handover.py: using LAC 22012 14:09:11.750831 tst handover.py: using RAC 82 14:09:11.878163 tst handover.py: using CellId 22012 14:09:12.005036 tst handover.py: using BVCI 22013 14:09:12.122468 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:09:12.133947 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:09:12.145257 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:09:12.156599 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:09:12.167914 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:09:12.179165 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:09:12.294186 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:09:12.409277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:09:12.853780 run create_hlr_db(pid=15705): Launched 14:09:12.970570 bus /sierra_2: Setting Powered False 14:09:14.031234 run create_hlr_db(pid=15705): Terminated: ok {rc=0} 14:09:14.428507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15708): Launched 14:09:14.732304 run osmo-hlr_10.42.42.2(pid=15709): Launched 14:09:14.847933 run osmo-stp_10.42.42.5: Starting osmo-stp 14:09:15.357557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15711): Launched 14:09:15.661222 run osmo-stp_10.42.42.5(pid=15712): Launched 14:09:15.777488 run osmo-msc_10.42.42.6: Starting osmo-msc 14:09:16.401864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15714): Launched 14:09:16.714803 run osmo-msc_10.42.42.6(pid=15715): Launched 14:09:17.243317 run osmo-stp_10.42.42.5(pid=15712): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15712)] 14:09:17.400512 run osmo-stp_10.42.42.5(pid=15712): stdout: | (launched: 2022-12-09_14:09:15.605617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:17.527611 run osmo-stp_10.42.42.5(pid=15712): stderr: | 20221209140915778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140915778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140915778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140915779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140915779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140915779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140915779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:17.654535 run osmo-stp_10.42.42.5(pid=15712): stdout: | (launched: 2022-12-09_14:09:15.605617) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:17.774946 run osmo-stp_10.42.42.5(pid=15712): stderr: | 20221209140915778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140915778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140915778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140915779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140915779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140915779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140915779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:17.918958 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15712): Process ended prematurely: osmo-stp_10.42.42.5(pid=15712) [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15712)] [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 14:09:17.927263 tst handover.py:18: Test FAILED (6.9 sec) 14:09:17.953880 run osmo-hlr_10.42.42.2(pid=15709): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15709)] 14:09:18.001855 run osmo-hlr_10.42.42.2(pid=15709): stdout: | (launched: 2022-12-09_14:09:14.676427) 14:09:18.051187 run osmo-hlr_10.42.42.2(pid=15709): stderr: | 20221209140914855 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140914855 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140914855 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140914855 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140914855 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140914855 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140914867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140914876 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140914876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140914876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:09:18.120447 run osmo-msc_10.42.42.6(pid=15715): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15715)] 14:09:18.168380 run osmo-msc_10.42.42.6(pid=15715): stdout: | (launched: 2022-12-09_14:09:16.659021) 14:09:18.217996 run osmo-msc_10.42.42.6(pid=15715): stderr: | 20221209140917157 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140917158 DLGLOBAL DEBUG validating counter group 0x7f17711c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140917158 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140917158 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140917158 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140917158 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140917160 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140917161 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140917161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140917161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:09:18.267773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15708): Terminating (SIGTERM) 14:09:18.307588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15711): Terminating (SIGTERM) 14:09:18.347276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15714): Terminating (SIGTERM) 14:09:18.387123 --- ParallelTerminationStrategy: PID 15708 died... 14:09:18.406229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15708): Terminated: ok {rc=0} 14:09:18.450436 --- ParallelTerminationStrategy: PID 15711 died... 14:09:18.468854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15711): Terminated: ok {rc=0} 14:09:18.512884 --- ParallelTerminationStrategy: PID 15714 died... 14:09:18.531860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15714): Terminated: ok {rc=0} 14:09:18.617339 bus /sierra_3: Setting Powered False 14:09:19.716260 bus /sierra_3: Setting Powered False 14:09:20.829197 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 14:09:22.098862 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:09:22.104666 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:09:22.157130 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:09:22.184589 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:09:22.238653 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:09:22.291446 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:09:22.318912 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:09:22.870680 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 14:09:22.876064 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:09:22.887522 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 14:09:22.936915 tst handover.py: using LAC 22013 14:09:23.063544 tst handover.py: using RAC 83 14:09:23.190365 tst handover.py: using CellId 22013 14:09:23.318409 tst handover.py: using BVCI 22014 14:09:23.435944 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 14:09:23.471752 tst handover.py: using LAC 22014 14:09:23.603065 tst handover.py: using RAC 84 14:09:23.730720 tst handover.py: using CellId 22014 14:09:23.856821 tst handover.py: using BVCI 22015 14:09:23.974511 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:09:23.985962 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:09:23.997237 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:09:24.008852 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:09:24.020575 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:09:24.032415 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 14:09:24.148415 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 14:09:24.263644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:09:24.708300 run create_hlr_db(pid=15720): Launched 14:09:24.825653 bus /sierra_2: Setting Powered False 14:09:25.886054 run create_hlr_db(pid=15720): Terminated: ok {rc=0} 14:09:26.302277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15722): Launched 14:09:26.628889 run osmo-hlr_10.42.42.2(pid=15723): Launched 14:09:26.754756 run osmo-stp_10.42.42.5: Starting osmo-stp 14:09:27.287064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15725): Launched 14:09:27.591286 run osmo-stp_10.42.42.5(pid=15726): Launched 14:09:27.706863 run osmo-msc_10.42.42.6: Starting osmo-msc 14:09:28.230394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15728): Launched 14:09:28.534818 run osmo-msc_10.42.42.6(pid=15729): Launched 14:09:28.706828 run osmo-stp_10.42.42.5(pid=15726): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15726)] 14:09:28.835881 run osmo-stp_10.42.42.5(pid=15726): stdout: | (launched: 2022-12-09_14:09:27.535315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:28.965924 run osmo-stp_10.42.42.5(pid=15726): stderr: | 20221209140927707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140927708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140927708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140927708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140927709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140927709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140927709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:29.093231 run osmo-stp_10.42.42.5(pid=15726): stdout: | (launched: 2022-12-09_14:09:27.535315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:29.213900 run osmo-stp_10.42.42.5(pid=15726): stderr: | 20221209140927707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140927708 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140927708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140927708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140927709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140927709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140927709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:29.358365 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15726): Process ended prematurely: osmo-stp_10.42.42.5(pid=15726) [trial-2360↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15726)] [trial-2360↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 14:09:29.366803 tst handover.py:18: Test FAILED (6.5 sec) 14:09:29.393308 run osmo-hlr_10.42.42.2(pid=15723): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15723)] 14:09:29.441286 run osmo-hlr_10.42.42.2(pid=15723): stdout: | (launched: 2022-12-09_14:09:26.569870) 14:09:29.490902 run osmo-hlr_10.42.42.2(pid=15723): stderr: | 20221209140926772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140926772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140926772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140926772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140926772 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140926772 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140926785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140926793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140926793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140926793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:09:29.559891 run osmo-msc_10.42.42.6(pid=15729): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15729)] 14:09:29.607908 run osmo-msc_10.42.42.6(pid=15729): stdout: | (launched: 2022-12-09_14:09:28.478868) 14:09:29.657178 run osmo-msc_10.42.42.6(pid=15729): stderr: | 20221209140928752 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140928752 DLGLOBAL DEBUG validating counter group 0x7f4c8fc78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140928753 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140928753 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140928753 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140928753 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140928755 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140928755 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140928755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140928755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:09:29.707005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15722): Terminating (SIGTERM) 14:09:29.747109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15725): Terminating (SIGTERM) 14:09:29.786950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15728): Terminating (SIGTERM) 14:09:29.827495 --- ParallelTerminationStrategy: PID 15722 died... 14:09:29.846918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15722): Terminated: ok {rc=0} 14:09:29.891973 --- ParallelTerminationStrategy: PID 15725 died... 14:09:29.910945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15725): Terminated: ok {rc=0} 14:09:29.955318 --- ParallelTerminationStrategy: PID 15728 died... 14:09:29.974261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15728): Terminated: ok {rc=0} 14:09:30.061299 bus /sierra_3: Setting Powered False 14:09:31.161341 bus /sierra_3: Setting Powered False 14:09:32.278007 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 14:09:33.542874 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:09:33.548664 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:09:33.614103 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:09:33.641972 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:09:33.695438 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:09:33.763536 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:09:33.790758 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:09:34.339961 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 14:09:34.346557 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:34.358229 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:09:34.406949 tst handover.py: using LAC 22015 14:09:34.527183 tst handover.py: using RAC 85 14:09:34.646394 tst handover.py: using CellId 22015 14:09:34.765747 tst handover.py: using BVCI 22016 14:09:34.875720 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:09:34.924211 tst handover.py: using LAC 22016 14:09:35.045299 tst handover.py: using RAC 86 14:09:35.169681 tst handover.py: using CellId 22016 14:09:35.289122 tst handover.py: using BVCI 22017 14:09:35.407856 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:35.419385 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:35.433610 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:35.445818 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:35.457240 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:35.468502 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:09:35.583956 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:09:35.701066 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:09:36.145433 run create_hlr_db(pid=15734): Launched 14:09:36.262332 bus /sierra_2: Setting Powered False 14:09:37.322726 run create_hlr_db(pid=15734): Terminated: ok {rc=0} 14:09:37.739540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15736): Launched 14:09:38.064040 run osmo-hlr_10.42.42.2(pid=15737): Launched 14:09:38.187904 run osmo-stp_10.42.42.5: Starting osmo-stp 14:09:38.724228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15739): Launched 14:09:39.048414 run osmo-stp_10.42.42.5(pid=15740): Launched 14:09:39.171285 run osmo-msc_10.42.42.6: Starting osmo-msc 14:09:39.730319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15742): Launched 14:09:40.054866 run osmo-msc_10.42.42.6(pid=15743): Launched 14:09:40.237269 run osmo-stp_10.42.42.5(pid=15740): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15740)] 14:09:40.373747 run osmo-stp_10.42.42.5(pid=15740): stdout: | (launched: 2022-12-09_14:09:38.988822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:40.511049 run osmo-stp_10.42.42.5(pid=15740): stderr: | 20221209140939184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140939184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140939185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140939185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140939186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140939186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140939186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:40.647314 run osmo-stp_10.42.42.5(pid=15740): stdout: | (launched: 2022-12-09_14:09:38.988822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:40.775681 run osmo-stp_10.42.42.5(pid=15740): stderr: | 20221209140939184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140939184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140939185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140939185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140939186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140939186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140939186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:40.929292 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15740): Process ended prematurely: osmo-stp_10.42.42.5(pid=15740) [trial-2360↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15740)] [trial-2360↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 14:09:40.938137 tst handover.py:18: Test FAILED (6.6 sec) 14:09:40.965477 run osmo-hlr_10.42.42.2(pid=15737): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15737)] 14:09:41.015393 run osmo-hlr_10.42.42.2(pid=15737): stdout: | (launched: 2022-12-09_14:09:38.005274) 14:09:41.066893 run osmo-hlr_10.42.42.2(pid=15737): stderr: | 20221209140938210 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140938210 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140938210 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140938210 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140938210 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140938210 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140938222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140938232 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140938232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140938232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:09:41.139440 run osmo-msc_10.42.42.6(pid=15743): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15743)] 14:09:41.189268 run osmo-msc_10.42.42.6(pid=15743): stdout: | (launched: 2022-12-09_14:09:39.995789) 14:09:41.240709 run osmo-msc_10.42.42.6(pid=15743): stderr: | 20221209140940322 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140940322 DLGLOBAL DEBUG validating counter group 0x7f65ce4e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140940322 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140940323 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140940323 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140940323 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140940325 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140940325 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140940325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140940325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:09:41.292497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15736): Terminating (SIGTERM) 14:09:41.334089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15739): Terminating (SIGTERM) 14:09:41.375634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15742): Terminating (SIGTERM) 14:09:41.417532 --- ParallelTerminationStrategy: PID 15736 died... 14:09:41.436930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15736): Terminated: ok {rc=0} 14:09:41.483238 --- ParallelTerminationStrategy: PID 15739 died... 14:09:41.502844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15739): Terminated: ok {rc=0} 14:09:41.548734 --- ParallelTerminationStrategy: PID 15742 died... 14:09:41.568270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15742): Terminated: ok {rc=0} 14:09:41.654633 bus /sierra_3: Setting Powered False 14:09:42.751908 bus /sierra_3: Setting Powered False 14:09:43.868477 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 14:09:45.136565 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:09:45.141780 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:09:45.204075 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:09:45.230708 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:09:45.283003 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:09:45.345963 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:09:45.372546 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:09:45.926979 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 14:09:45.932834 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:09:45.944205 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:09:45.999526 tst handover.py: using LAC 22017 14:09:46.137772 tst handover.py: using RAC 87 14:09:46.296315 tst handover.py: using CellId 22017 14:09:46.418947 tst handover.py: using BVCI 22018 14:09:46.535708 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:09:46.586889 tst handover.py: using LAC 22018 14:09:46.707436 tst handover.py: using RAC 88 14:09:46.881413 tst handover.py: using CellId 22018 14:09:47.031752 tst handover.py: using BVCI 22019 14:09:47.184030 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:09:47.196276 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:09:47.208437 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:09:47.220828 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:09:47.232752 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:09:47.244861 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:09:47.363420 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:09:47.482862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:09:47.957899 run create_hlr_db(pid=15748): Launched 14:09:48.091085 bus /sierra_2: Setting Powered False 14:09:49.150120 run create_hlr_db(pid=15748): Terminated: ok {rc=0} 14:09:49.547663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15750): Launched 14:09:49.851133 run osmo-hlr_10.42.42.2(pid=15751): Launched 14:09:49.966800 run osmo-stp_10.42.42.5: Starting osmo-stp 14:09:50.475872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15753): Launched 14:09:50.780164 run osmo-stp_10.42.42.5(pid=15754): Launched 14:09:50.896283 run osmo-msc_10.42.42.6: Starting osmo-msc 14:09:51.418518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15756): Launched 14:09:51.723241 run osmo-msc_10.42.42.6(pid=15757): Launched 14:09:51.893398 run osmo-stp_10.42.42.5(pid=15754): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15754)] 14:09:52.021820 run osmo-stp_10.42.42.5(pid=15754): stdout: | (launched: 2022-12-09_14:09:50.724006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:52.150684 run osmo-stp_10.42.42.5(pid=15754): stderr: | 20221209140950895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140950896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140950896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140950896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140950898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140950899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140950899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:52.276715 run osmo-stp_10.42.42.5(pid=15754): stdout: | (launched: 2022-12-09_14:09:50.724006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:09:52.396543 run osmo-stp_10.42.42.5(pid=15754): stderr: | 20221209140950895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209140950896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209140950896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209140950896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209140950898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209140950899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209140950899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:09:52.540142 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15754): Process ended prematurely: osmo-stp_10.42.42.5(pid=15754) [trial-2360↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15754)] [trial-2360↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 14:09:52.548336 tst handover.py:18: Test FAILED (6.6 sec) 14:09:52.574964 run osmo-hlr_10.42.42.2(pid=15751): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15751)] 14:09:52.622953 run osmo-hlr_10.42.42.2(pid=15751): stdout: | (launched: 2022-12-09_14:09:49.795676) 14:09:52.672403 run osmo-hlr_10.42.42.2(pid=15751): stderr: | 20221209140949972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209140949972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209140949972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209140949972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209140949972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209140949972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209140949984 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209140949993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209140949994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209140949994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:09:52.741607 run osmo-msc_10.42.42.6(pid=15757): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15757)] 14:09:52.789405 run osmo-msc_10.42.42.6(pid=15757): stdout: | (launched: 2022-12-09_14:09:51.667536) 14:09:52.838784 run osmo-msc_10.42.42.6(pid=15757): stderr: | 20221209140951943 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209140951943 DLGLOBAL DEBUG validating counter group 0x7f88fe891c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209140951943 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209140951943 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209140951943 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209140951943 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209140951945 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209140951946 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209140951946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209140951946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:09:52.888480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15750): Terminating (SIGTERM) 14:09:52.928359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15753): Terminating (SIGTERM) 14:09:52.968052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15756): Terminating (SIGTERM) 14:09:53.007890 --- ParallelTerminationStrategy: PID 15750 died... 14:09:53.026931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15750): Terminated: ok {rc=0} 14:09:53.071712 --- ParallelTerminationStrategy: PID 15753 died... 14:09:53.090440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15753): Terminated: ok {rc=0} 14:09:53.134537 --- ParallelTerminationStrategy: PID 15756 died... 14:09:53.153136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15756): Terminated: ok {rc=0} 14:09:53.236047 bus /sierra_3: Setting Powered False 14:09:54.333952 bus /sierra_3: Setting Powered False 14:09:55.449434 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 14:09:56.716696 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:09:56.721688 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:09:56.772112 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:09:56.798832 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:09:56.855927 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:09:56.905926 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:09:56.932355 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:09:57.478764 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 14:09:57.484134 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:57.494835 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:09:57.531718 tst handover.py: using LAC 22019 14:09:57.658733 tst handover.py: using RAC 89 14:09:57.784330 tst handover.py: using CellId 22019 14:09:57.910599 tst handover.py: using BVCI 22020 14:09:58.030493 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:09:58.079067 tst handover.py: using LAC 22020 14:09:58.206322 tst handover.py: using RAC 90 14:09:58.333897 tst handover.py: using CellId 22020 14:09:58.459551 tst handover.py: using BVCI 22021 14:09:58.578353 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:58.589634 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:58.600493 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:58.612145 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:58.623681 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:09:58.635123 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:09:58.749512 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:09:58.863683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:09:59.309046 run create_hlr_db(pid=15763): Launched 14:09:59.426374 bus /sierra_2: Setting Powered False 14:10:00.486968 run create_hlr_db(pid=15763): Terminated: ok {rc=0} 14:10:00.898236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15765): Launched 14:10:01.241242 run osmo-hlr_10.42.42.2(pid=15766): Launched 14:10:01.532570 run osmo-stp_10.42.42.5: Starting osmo-stp 14:10:02.122148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15771): Launched 14:10:02.457696 run osmo-stp_10.42.42.5(pid=15772): Launched 14:10:02.582816 run osmo-msc_10.42.42.6: Starting osmo-msc 14:10:03.140635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15774): Launched 14:10:03.464743 run osmo-msc_10.42.42.6(pid=15775): Launched 14:10:03.647452 run osmo-stp_10.42.42.5(pid=15772): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15772)] 14:10:03.783457 run osmo-stp_10.42.42.5(pid=15772): stdout: | (launched: 2022-12-09_14:10:02.398312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:03.921314 run osmo-stp_10.42.42.5(pid=15772): stderr: | 20221209141002590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209141002591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209141002591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209141002591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209141002592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209141002592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209141002592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:04.057549 run osmo-stp_10.42.42.5(pid=15772): stdout: | (launched: 2022-12-09_14:10:02.398312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:04.186345 run osmo-stp_10.42.42.5(pid=15772): stderr: | 20221209141002590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209141002591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209141002591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209141002591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209141002592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209141002592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209141002592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:04.340220 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15772): Process ended prematurely: osmo-stp_10.42.42.5(pid=15772) [trial-2360↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15772)] [trial-2360↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 14:10:04.349275 tst handover.py:18: Test FAILED (6.9 sec) 14:10:04.376887 run osmo-hlr_10.42.42.2(pid=15766): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15766)] 14:10:04.426745 run osmo-hlr_10.42.42.2(pid=15766): stdout: | (launched: 2022-12-09_14:10:01.180061) 14:10:04.478121 run osmo-hlr_10.42.42.2(pid=15766): stderr: | 20221209141001392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209141001393 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209141001393 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209141001393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209141001393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209141001393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209141001409 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209141001418 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209141001418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209141001418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:10:04.550412 run osmo-msc_10.42.42.6(pid=15775): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15775)] 14:10:04.600067 run osmo-msc_10.42.42.6(pid=15775): stdout: | (launched: 2022-12-09_14:10:03.405762) 14:10:04.651223 run osmo-msc_10.42.42.6(pid=15775): stderr: | 20221209141003730 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209141003731 DLGLOBAL DEBUG validating counter group 0x7fe95cf85c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209141003731 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209141003731 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209141003731 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209141003731 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209141003733 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209141003733 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209141003733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209141003734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:10:04.702808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15765): Terminating (SIGTERM) 14:10:04.744211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15771): Terminating (SIGTERM) 14:10:04.786163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15774): Terminating (SIGTERM) 14:10:04.828273 --- ParallelTerminationStrategy: PID 15765 died... 14:10:04.848434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15765): Terminated: ok {rc=0} 14:10:04.894937 --- ParallelTerminationStrategy: PID 15771 died... 14:10:04.914726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15771): Terminated: ok {rc=0} 14:10:04.961064 --- ParallelTerminationStrategy: PID 15774 died... 14:10:04.980716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15774): Terminated: ok {rc=0} 14:10:05.068352 bus /sierra_3: Setting Powered False 14:10:06.166969 bus /sierra_3: Setting Powered False 14:10:07.283337 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 14:10:08.546163 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:10:08.551604 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:10:08.603145 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:10:08.630522 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:10:08.682701 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:10:08.733284 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:10:08.760372 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:10:09.313240 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 14:10:09.318494 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:10:09.329817 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:10:09.364878 tst handover.py: using LAC 22021 14:10:09.490881 tst handover.py: using RAC 91 14:10:09.622201 tst handover.py: using CellId 22021 14:10:09.748200 tst handover.py: using BVCI 22022 14:10:09.865955 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:10:09.913044 tst handover.py: using LAC 22022 14:10:10.038746 tst handover.py: using RAC 92 14:10:10.163813 tst handover.py: using CellId 22022 14:10:10.290297 tst handover.py: using BVCI 22023 14:10:10.407928 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:10:10.419190 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:10:10.430326 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:10:10.441375 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:10:10.452437 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:10:10.463464 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:10:10.577883 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:10:10.692146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:10:11.139535 run create_hlr_db(pid=15780): Launched 14:10:11.255377 bus /sierra_2: Setting Powered False 14:10:12.315632 run create_hlr_db(pid=15780): Terminated: ok {rc=0} 14:10:12.714307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15782): Launched 14:10:13.017451 run osmo-hlr_10.42.42.2(pid=15783): Launched 14:10:13.133855 run osmo-stp_10.42.42.5: Starting osmo-stp 14:10:13.645628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15785): Launched 14:10:13.949774 run osmo-stp_10.42.42.5(pid=15786): Launched 14:10:14.066181 run osmo-msc_10.42.42.6: Starting osmo-msc 14:10:14.590186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15788): Launched 14:10:14.894084 run osmo-msc_10.42.42.6(pid=15789): Launched 14:10:15.064322 run osmo-stp_10.42.42.5(pid=15786): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15786)] 14:10:15.193222 run osmo-stp_10.42.42.5(pid=15786): stdout: | (launched: 2022-12-09_14:10:13.893559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:15.322572 run osmo-stp_10.42.42.5(pid=15786): stderr: | 20221209141014063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209141014063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209141014063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209141014064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209141014064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209141014064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209141014064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:15.449677 run osmo-stp_10.42.42.5(pid=15786): stdout: | (launched: 2022-12-09_14:10:13.893559) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:15.570501 run osmo-stp_10.42.42.5(pid=15786): stderr: | 20221209141014063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209141014063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209141014063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209141014064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209141014064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209141014064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209141014064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:15.714892 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15786): Process ended prematurely: osmo-stp_10.42.42.5(pid=15786) [trial-2360↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15786)] [trial-2360↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 14:10:15.723159 tst handover.py:18: Test FAILED (6.4 sec) 14:10:15.749673 run osmo-hlr_10.42.42.2(pid=15783): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15783)] 14:10:15.798240 run osmo-hlr_10.42.42.2(pid=15783): stdout: | (launched: 2022-12-09_14:10:12.961623) 14:10:15.854977 run osmo-hlr_10.42.42.2(pid=15783): stderr: | 20221209141013138 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209141013138 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209141013138 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209141013138 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209141013138 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209141013138 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209141013150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209141013158 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209141013158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209141013158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:10:15.925784 run osmo-msc_10.42.42.6(pid=15789): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15789)] 14:10:15.974894 run osmo-msc_10.42.42.6(pid=15789): stdout: | (launched: 2022-12-09_14:10:14.837845) 14:10:16.025683 run osmo-msc_10.42.42.6(pid=15789): stderr: | 20221209141015112 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209141015112 DLGLOBAL DEBUG validating counter group 0x7fc971b3cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209141015112 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209141015113 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209141015113 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209141015113 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209141015115 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209141015116 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209141015116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209141015116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:10:16.077381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15782): Terminating (SIGTERM) 14:10:16.133590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15785): Terminating (SIGTERM) 14:10:16.189634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15788): Terminating (SIGTERM) 14:10:16.231388 --- ParallelTerminationStrategy: PID 15782 died... 14:10:16.251983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15782): Terminated: ok {rc=0} 14:10:16.311885 --- ParallelTerminationStrategy: PID 15785 died... 14:10:16.339042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15785): Terminated: ok {rc=0} 14:10:16.400673 --- ParallelTerminationStrategy: PID 15788 died... 14:10:16.420350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15788): Terminated: ok {rc=0} 14:10:16.512889 bus /sierra_3: Setting Powered False 14:10:17.619627 bus /sierra_3: Setting Powered False 14:10:18.736844 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2360 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 14:10:19.996276 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:10:20.002134 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:10:20.065821 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:10:20.093378 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:10:20.145037 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:10:20.209073 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:10:20.236150 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:10:20.788684 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2360 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 14:10:20.794105 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:10:20.805385 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:10:20.853624 tst handover.py: using LAC 22023 14:10:20.981239 tst handover.py: using RAC 93 14:10:21.106593 tst handover.py: using CellId 22023 14:10:21.232092 tst handover.py: using BVCI 22024 14:10:21.349987 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:10:21.397801 tst handover.py: using LAC 22024 14:10:21.516623 tst handover.py: using RAC 94 14:10:21.634457 tst handover.py: using CellId 22024 14:10:21.751938 tst handover.py: using BVCI 22025 14:10:21.861971 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:10:21.872836 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:10:21.883577 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:10:21.894574 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:10:21.905551 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:10:21.916234 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:10:22.036557 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:10:22.158683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:10:22.633553 run create_hlr_db(pid=15794): Launched 14:10:22.765830 bus /sierra_2: Setting Powered False 14:10:23.830069 run create_hlr_db(pid=15794): Terminated: ok {rc=0} 14:10:24.254178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15796): Launched 14:10:24.581261 run osmo-hlr_10.42.42.2(pid=15797): Launched 14:10:24.704623 run osmo-stp_10.42.42.5: Starting osmo-stp 14:10:25.237919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15799): Launched 14:10:25.556518 run osmo-stp_10.42.42.5(pid=15800): Launched 14:10:25.678125 run osmo-msc_10.42.42.6: Starting osmo-msc 14:10:26.228535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15802): Launched 14:10:26.547615 run osmo-msc_10.42.42.6(pid=15803): Launched 14:10:26.726559 run osmo-stp_10.42.42.5(pid=15800): ERR: Terminated: ERROR {rc=1} [trial-2360↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15800)] 14:10:26.860889 run osmo-stp_10.42.42.5(pid=15800): stdout: | (launched: 2022-12-09_14:10:25.497705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:26.995375 run osmo-stp_10.42.42.5(pid=15800): stderr: | 20221209141025690 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209141025690 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209141025690 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209141025691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209141025691 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209141025691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209141025691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:27.129516 run osmo-stp_10.42.42.5(pid=15800): stdout: | (launched: 2022-12-09_14:10:25.497705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:27.255628 run osmo-stp_10.42.42.5(pid=15800): stderr: | 20221209141025690 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209141025690 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209141025690 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209141025691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209141025691 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209141025691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209141025691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:27.407130 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15800): Process ended prematurely: osmo-stp_10.42.42.5(pid=15800) [trial-2360↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15800)] [trial-2360↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 14:10:27.415638 tst handover.py:18: Test FAILED (6.6 sec) 14:10:27.442821 run osmo-hlr_10.42.42.2(pid=15797): ERR: Terminated: ERROR {rc=237} [trial-2360↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15797)] 14:10:27.492524 run osmo-hlr_10.42.42.2(pid=15797): stdout: | (launched: 2022-12-09_14:10:24.521559) 14:10:27.543840 run osmo-hlr_10.42.42.2(pid=15797): stderr: | 20221209141024720 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209141024720 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209141024720 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209141024720 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209141024720 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209141024720 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209141024733 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209141024741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209141024741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209141024741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:10:27.615782 run osmo-msc_10.42.42.6(pid=15803): ERR: Terminated: ERROR {rc=2} [trial-2360↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15803)] 14:10:27.665531 run osmo-msc_10.42.42.6(pid=15803): stdout: | (launched: 2022-12-09_14:10:26.488718) 14:10:27.716251 run osmo-msc_10.42.42.6(pid=15803): stderr: | 20221209141026814 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209141026814 DLGLOBAL DEBUG validating counter group 0x7f21a7560c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209141026814 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209141026815 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209141026815 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209141026815 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209141026817 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209141026817 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209141026817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209141026817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:10:27.767264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15796): Terminating (SIGTERM) 14:10:27.808428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15799): Terminating (SIGTERM) 14:10:27.849578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15802): Terminating (SIGTERM) 14:10:27.890826 --- ParallelTerminationStrategy: PID 15796 died... 14:10:27.910526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15796): Terminated: ok {rc=0} 14:10:27.955683 --- ParallelTerminationStrategy: PID 15799 died... 14:10:27.974879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15799): Terminated: ok {rc=0} 14:10:28.020478 --- ParallelTerminationStrategy: PID 15802 died... 14:10:28.040015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15802): Terminated: ok {rc=0} 14:10:28.127246 bus /sierra_3: Setting Powered False 14:10:29.225210 bus /sierra_3: Setting Powered False 14:10:30.341883 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2360 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 14:10:31.638577 tst trial-2360: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360/run.2022-12-09_12-45-57/trial-2360.xml -------------------------------------------------------------------------------------------- trial-2360 FAIL -------------------------------------------------------------------------------------------- 14:10:33.595416 tst trial-2360: trial-2360: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=6824): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6824) [trial-2360↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6824)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.2 sec) Error: osmo-stp_10.42.42.5(pid=6834): Process ended prematurely: osmo-stp_10.42.42.5(pid=6834) [trial-2360↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6834)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=6843): Process ended prematurely: osmo-nitb_10.42.42.2(pid=6843) [trial-2360↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=6843)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6853): Process ended prematurely: osmo-stp_10.42.42.5(pid=6853) [trial-2360↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6853)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6867): Process ended prematurely: osmo-stp_10.42.42.5(pid=6867) [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6867)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6878): Process ended prematurely: osmo-stp_10.42.42.5(pid=6878) [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6878)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=6893): Process ended prematurely: osmo-stp_10.42.42.5(pid=6893) [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6893)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6904): Process ended prematurely: osmo-stp_10.42.42.5(pid=6904) [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6904)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6918): Process ended prematurely: osmo-stp_10.42.42.5(pid=6918) [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6918)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6929): Process ended prematurely: osmo-stp_10.42.42.5(pid=6929) [trial-2360↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6929)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6943): Process ended prematurely: osmo-stp_10.42.42.5(pid=6943) [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6943)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6957): Process ended prematurely: osmo-stp_10.42.42.5(pid=6957) [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6957)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=6971): Process ended prematurely: osmo-stp_10.42.42.5(pid=6971) [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6971)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6982): Process ended prematurely: osmo-stp_10.42.42.5(pid=6982) [trial-2360↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6982)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=6996): Process ended prematurely: osmo-stp_10.42.42.5(pid=6996) [trial-2360↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6996)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7007): Process ended prematurely: osmo-stp_10.42.42.5(pid=7007) [trial-2360↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7007)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7021): Process ended prematurely: osmo-stp_10.42.42.5(pid=7021) [trial-2360↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7021)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7032): Process ended prematurely: osmo-stp_10.42.42.5(pid=7032) [trial-2360↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7032)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7049): Process ended prematurely: osmo-stp_10.42.42.5(pid=7049) [trial-2360↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7049)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7060): Process ended prematurely: osmo-stp_10.42.42.5(pid=7060) [trial-2360↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7060)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.8 sec) Error: osmo-stp_10.42.42.5(pid=7078): Process ended prematurely: osmo-stp_10.42.42.5(pid=7078) [trial-2360↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7078)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=7090): Process ended prematurely: osmo-stp_10.42.42.5(pid=7090) [trial-2360↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7090)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=7108): Process ended prematurely: osmo-stp_10.42.42.5(pid=7108) [trial-2360↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7108)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7120): Process ended prematurely: osmo-stp_10.42.42.5(pid=7120) [trial-2360↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7120)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7131): Process ended prematurely: osmo-stp_10.42.42.5(pid=7131) [trial-2360↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7131)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=7148): Process ended prematurely: osmo-stp_10.42.42.5(pid=7148) [trial-2360↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7148)] FAIL: iperf3.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=7432): Process ended prematurely: osmo-stp_10.42.42.5(pid=7432) [trial-2360↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7432)] FAIL: iperf3m4.py (11.8 sec) Error: osmo-stp_10.42.42.5(pid=7450): Process ended prematurely: osmo-stp_10.42.42.5(pid=7450) [trial-2360↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7450)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7460): Process ended prematurely: osmo-stp_10.42.42.5(pid=7460) [trial-2360↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7460)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=7470): Process ended prematurely: osmo-stp_10.42.42.5(pid=7470) [trial-2360↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7470)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=7487): Process ended prematurely: osmo-stp_10.42.42.5(pid=7487) [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7487)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=7499): Process ended prematurely: osmo-stp_10.42.42.5(pid=7499) [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7499)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=7517): Process ended prematurely: osmo-stp_10.42.42.5(pid=7517) [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7517)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=7528): Process ended prematurely: osmo-stp_10.42.42.5(pid=7528) [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7528)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7538): Process ended prematurely: osmo-stp_10.42.42.5(pid=7538) [trial-2360↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7538)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=7556): Process ended prematurely: osmo-stp_10.42.42.5(pid=7556) [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7556)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=7571): Process ended prematurely: osmo-stp_10.42.42.5(pid=7571) [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7571)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=7589): Process ended prematurely: osmo-stp_10.42.42.5(pid=7589) [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7589)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7599): Process ended prematurely: osmo-stp_10.42.42.5(pid=7599) [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7599)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7609): Process ended prematurely: osmo-stp_10.42.42.5(pid=7609) [trial-2360↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7609)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=7623): Process ended prematurely: osmo-stp_10.42.42.5(pid=7623) [trial-2360↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7623)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7637): Process ended prematurely: osmo-stp_10.42.42.5(pid=7637) [trial-2360↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7637)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=7645): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7645) [trial-2360↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7645)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=7655): Process ended prematurely: osmo-stp_10.42.42.5(pid=7655) [trial-2360↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7655)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=7664): Process ended prematurely: osmo-nitb_10.42.42.2(pid=7664) [trial-2360↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=7664)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7674): Process ended prematurely: osmo-stp_10.42.42.5(pid=7674) [trial-2360↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7674)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7688): Process ended prematurely: osmo-stp_10.42.42.5(pid=7688) [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7688)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=7699): Process ended prematurely: osmo-stp_10.42.42.5(pid=7699) [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7699)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7713): Process ended prematurely: osmo-stp_10.42.42.5(pid=7713) [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7713)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7724): Process ended prematurely: osmo-stp_10.42.42.5(pid=7724) [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7724)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7742): Process ended prematurely: osmo-stp_10.42.42.5(pid=7742) [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7742)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7753): Process ended prematurely: osmo-stp_10.42.42.5(pid=7753) [trial-2360↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7753)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7767): Process ended prematurely: osmo-stp_10.42.42.5(pid=7767) [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7767)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7778): Process ended prematurely: osmo-stp_10.42.42.5(pid=7778) [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7778)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7792): Process ended prematurely: osmo-stp_10.42.42.5(pid=7792) [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7792)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7803): Process ended prematurely: osmo-stp_10.42.42.5(pid=7803) [trial-2360↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7803)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=7817): Process ended prematurely: osmo-stp_10.42.42.5(pid=7817) [trial-2360↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7817)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7828): Process ended prematurely: osmo-stp_10.42.42.5(pid=7828) [trial-2360↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7828)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=7842): Process ended prematurely: osmo-stp_10.42.42.5(pid=7842) [trial-2360↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7842)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=7853): Process ended prematurely: osmo-stp_10.42.42.5(pid=7853) [trial-2360↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7853)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=7867): Process ended prematurely: osmo-stp_10.42.42.5(pid=7867) [trial-2360↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7867)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=7878): Process ended prematurely: osmo-stp_10.42.42.5(pid=7878) [trial-2360↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7878)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=7897): Process ended prematurely: osmo-stp_10.42.42.5(pid=7897) [trial-2360↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7897)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=7912): Process ended prematurely: osmo-stp_10.42.42.5(pid=7912) [trial-2360↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7912)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=7931): Process ended prematurely: osmo-stp_10.42.42.5(pid=7931) [trial-2360↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7931)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=7941): Process ended prematurely: osmo-stp_10.42.42.5(pid=7941) [trial-2360↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7941)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=7951): Process ended prematurely: osmo-stp_10.42.42.5(pid=7951) [trial-2360↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7951)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=7968): Process ended prematurely: osmo-stp_10.42.42.5(pid=7968) [trial-2360↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7968)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=7980): Process ended prematurely: osmo-stp_10.42.42.5(pid=7980) [trial-2360↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7980)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=7998): Process ended prematurely: osmo-stp_10.42.42.5(pid=7998) [trial-2360↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=7998)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8008): Process ended prematurely: osmo-stp_10.42.42.5(pid=8008) [trial-2360↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8008)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8018): Process ended prematurely: osmo-stp_10.42.42.5(pid=8018) [trial-2360↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8018)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=8036): Process ended prematurely: osmo-stp_10.42.42.5(pid=8036) [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8036)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=8048): Process ended prematurely: osmo-stp_10.42.42.5(pid=8048) [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8048)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=8066): Process ended prematurely: osmo-stp_10.42.42.5(pid=8066) [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8066)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8076): Process ended prematurely: osmo-stp_10.42.42.5(pid=8076) [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8076)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8087): Process ended prematurely: osmo-stp_10.42.42.5(pid=8087) [trial-2360↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8087)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=8104): Process ended prematurely: osmo-stp_10.42.42.5(pid=8104) [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8104)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=8117): Process ended prematurely: osmo-stp_10.42.42.5(pid=8117) [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8117)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=8135): Process ended prematurely: osmo-stp_10.42.42.5(pid=8135) [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8135)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8145): Process ended prematurely: osmo-stp_10.42.42.5(pid=8145) [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8145)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8155): Process ended prematurely: osmo-stp_10.42.42.5(pid=8155) [trial-2360↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8155)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8168): Process ended prematurely: osmo-stp_10.42.42.5(pid=8168) [trial-2360↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8168)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8182): Process ended prematurely: osmo-stp_10.42.42.5(pid=8182) [trial-2360↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8182)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=8191): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8191) [trial-2360↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8191)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8201): Process ended prematurely: osmo-stp_10.42.42.5(pid=8201) [trial-2360↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8201)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=8210): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8210) [trial-2360↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8210)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=8220): Process ended prematurely: osmo-stp_10.42.42.5(pid=8220) [trial-2360↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8220)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8235): Process ended prematurely: osmo-stp_10.42.42.5(pid=8235) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8235)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8247): Process ended prematurely: osmo-stp_10.42.42.5(pid=8247) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8247)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8264): Process ended prematurely: osmo-stp_10.42.42.5(pid=8264) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8264)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8275): Process ended prematurely: osmo-stp_10.42.42.5(pid=8275) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8275)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=8289): Process ended prematurely: osmo-stp_10.42.42.5(pid=8289) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8289)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8300): Process ended prematurely: osmo-stp_10.42.42.5(pid=8300) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8300)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8314): Process ended prematurely: osmo-stp_10.42.42.5(pid=8314) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8314)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8325): Process ended prematurely: osmo-stp_10.42.42.5(pid=8325) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8325)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8339): Process ended prematurely: osmo-stp_10.42.42.5(pid=8339) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8339)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8350): Process ended prematurely: osmo-stp_10.42.42.5(pid=8350) [trial-2360↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8350)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8365): Process ended prematurely: osmo-stp_10.42.42.5(pid=8365) [trial-2360↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8365)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8376): Process ended prematurely: osmo-stp_10.42.42.5(pid=8376) [trial-2360↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8376)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8390): Process ended prematurely: osmo-stp_10.42.42.5(pid=8390) [trial-2360↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8390)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8401): Process ended prematurely: osmo-stp_10.42.42.5(pid=8401) [trial-2360↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8401)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8415): Process ended prematurely: osmo-stp_10.42.42.5(pid=8415) [trial-2360↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8415)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8426): Process ended prematurely: osmo-stp_10.42.42.5(pid=8426) [trial-2360↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8426)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8442): Process ended prematurely: osmo-stp_10.42.42.5(pid=8442) [trial-2360↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8442)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8453): Process ended prematurely: osmo-stp_10.42.42.5(pid=8453) [trial-2360↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8453)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=8546): Process ended prematurely: osmo-stp_10.42.42.5(pid=8546) [trial-2360↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8546)] FAIL: emergency_preemptive_call.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=8749): Process ended prematurely: osmo-stp_10.42.42.5(pid=8749) [trial-2360↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8749)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=8768): Process ended prematurely: osmo-stp_10.42.42.5(pid=8768) [trial-2360↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8768)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=8781): Process ended prematurely: osmo-stp_10.42.42.5(pid=8781) [trial-2360↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8781)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=8799): Process ended prematurely: osmo-stp_10.42.42.5(pid=8799) [trial-2360↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8799)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8809): Process ended prematurely: osmo-stp_10.42.42.5(pid=8809) [trial-2360↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8809)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8819): Process ended prematurely: osmo-stp_10.42.42.5(pid=8819) [trial-2360↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8819)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=8836): Process ended prematurely: osmo-stp_10.42.42.5(pid=8836) [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8836)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=8849): Process ended prematurely: osmo-stp_10.42.42.5(pid=8849) [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8849)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=8868): Process ended prematurely: osmo-stp_10.42.42.5(pid=8868) [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8868)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8881): Process ended prematurely: osmo-stp_10.42.42.5(pid=8881) [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8881)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8891): Process ended prematurely: osmo-stp_10.42.42.5(pid=8891) [trial-2360↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8891)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=8909): Process ended prematurely: osmo-stp_10.42.42.5(pid=8909) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8909)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=8921): Process ended prematurely: osmo-stp_10.42.42.5(pid=8921) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8921)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=8939): Process ended prematurely: osmo-stp_10.42.42.5(pid=8939) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8939)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=8949): Process ended prematurely: osmo-stp_10.42.42.5(pid=8949) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8949)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8959): Process ended prematurely: osmo-stp_10.42.42.5(pid=8959) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8959)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=8976): Process ended prematurely: osmo-stp_10.42.42.5(pid=8976) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8976)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=8988): Process ended prematurely: osmo-stp_10.42.42.5(pid=8988) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8988)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=9006): Process ended prematurely: osmo-stp_10.42.42.5(pid=9006) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9006)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9016): Process ended prematurely: osmo-stp_10.42.42.5(pid=9016) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9016)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9026): Process ended prematurely: osmo-stp_10.42.42.5(pid=9026) [trial-2360↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9026)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=9047): Process ended prematurely: osmo-stp_10.42.42.5(pid=9047) [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9047)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=9059): Process ended prematurely: osmo-stp_10.42.42.5(pid=9059) [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9059)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=9077): Process ended prematurely: osmo-stp_10.42.42.5(pid=9077) [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9077)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=9087): Process ended prematurely: osmo-stp_10.42.42.5(pid=9087) [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9087)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9097): Process ended prematurely: osmo-stp_10.42.42.5(pid=9097) [trial-2360↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9097)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9110): Process ended prematurely: osmo-stp_10.42.42.5(pid=9110) [trial-2360↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9110)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9124): Process ended prematurely: osmo-stp_10.42.42.5(pid=9124) [trial-2360↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9124)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=9132): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9132) [trial-2360↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9132)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9142): Process ended prematurely: osmo-stp_10.42.42.5(pid=9142) [trial-2360↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9142)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=9151): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9151) [trial-2360↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9151)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=9161): Process ended prematurely: osmo-stp_10.42.42.5(pid=9161) [trial-2360↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9161)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9175): Process ended prematurely: osmo-stp_10.42.42.5(pid=9175) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9175)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9186): Process ended prematurely: osmo-stp_10.42.42.5(pid=9186) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9186)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9200): Process ended prematurely: osmo-stp_10.42.42.5(pid=9200) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9200)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9214): Process ended prematurely: osmo-stp_10.42.42.5(pid=9214) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9214)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9231): Process ended prematurely: osmo-stp_10.42.42.5(pid=9231) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9231)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9242): Process ended prematurely: osmo-stp_10.42.42.5(pid=9242) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9242)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9256): Process ended prematurely: osmo-stp_10.42.42.5(pid=9256) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9256)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9267): Process ended prematurely: osmo-stp_10.42.42.5(pid=9267) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9267)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9281): Process ended prematurely: osmo-stp_10.42.42.5(pid=9281) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9281)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9292): Process ended prematurely: osmo-stp_10.42.42.5(pid=9292) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9292)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9307): Process ended prematurely: osmo-stp_10.42.42.5(pid=9307) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9307)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9318): Process ended prematurely: osmo-stp_10.42.42.5(pid=9318) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9318)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9333): Process ended prematurely: osmo-stp_10.42.42.5(pid=9333) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9333)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9344): Process ended prematurely: osmo-stp_10.42.42.5(pid=9344) [trial-2360↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9344)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9361): Process ended prematurely: osmo-stp_10.42.42.5(pid=9361) [trial-2360↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9361)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9372): Process ended prematurely: osmo-stp_10.42.42.5(pid=9372) [trial-2360↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9372)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=9390): Process ended prematurely: osmo-stp_10.42.42.5(pid=9390) [trial-2360↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9390)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=9402): Process ended prematurely: osmo-stp_10.42.42.5(pid=9402) [trial-2360↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9402)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=9420): Process ended prematurely: osmo-stp_10.42.42.5(pid=9420) [trial-2360↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9420)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9430): Process ended prematurely: osmo-stp_10.42.42.5(pid=9430) [trial-2360↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9430)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9440): Process ended prematurely: osmo-stp_10.42.42.5(pid=9440) [trial-2360↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9440)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=9457): Process ended prematurely: osmo-stp_10.42.42.5(pid=9457) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9457)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=9469): Process ended prematurely: osmo-stp_10.42.42.5(pid=9469) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9469)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=9487): Process ended prematurely: osmo-stp_10.42.42.5(pid=9487) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9487)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9497): Process ended prematurely: osmo-stp_10.42.42.5(pid=9497) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9497)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9507): Process ended prematurely: osmo-stp_10.42.42.5(pid=9507) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9507)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=9524): Process ended prematurely: osmo-stp_10.42.42.5(pid=9524) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9524)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=9536): Process ended prematurely: osmo-stp_10.42.42.5(pid=9536) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9536)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=9554): Process ended prematurely: osmo-stp_10.42.42.5(pid=9554) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9554)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9567): Process ended prematurely: osmo-stp_10.42.42.5(pid=9567) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9567)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9577): Process ended prematurely: osmo-stp_10.42.42.5(pid=9577) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9577)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=9595): Process ended prematurely: osmo-stp_10.42.42.5(pid=9595) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9595)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=9607): Process ended prematurely: osmo-stp_10.42.42.5(pid=9607) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9607)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=9626): Process ended prematurely: osmo-stp_10.42.42.5(pid=9626) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9626)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9637): Process ended prematurely: osmo-stp_10.42.42.5(pid=9637) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9637)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9647): Process ended prematurely: osmo-stp_10.42.42.5(pid=9647) [trial-2360↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9647)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9661): Process ended prematurely: osmo-stp_10.42.42.5(pid=9661) [trial-2360↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9661)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9675): Process ended prematurely: osmo-stp_10.42.42.5(pid=9675) [trial-2360↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9675)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.6 sec) Error: osmo-nitb_10.42.42.2(pid=9683): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9683) [trial-2360↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9683)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9693): Process ended prematurely: osmo-stp_10.42.42.5(pid=9693) [trial-2360↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9693)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=9702): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9702) [trial-2360↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9702)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9712): Process ended prematurely: osmo-stp_10.42.42.5(pid=9712) [trial-2360↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9712)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9726): Process ended prematurely: osmo-stp_10.42.42.5(pid=9726) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9726)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9737): Process ended prematurely: osmo-stp_10.42.42.5(pid=9737) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9737)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9752): Process ended prematurely: osmo-stp_10.42.42.5(pid=9752) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9752)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9763): Process ended prematurely: osmo-stp_10.42.42.5(pid=9763) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9763)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=10048): Process ended prematurely: osmo-stp_10.42.42.5(pid=10048) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10048)] FAIL: mo_mt_call_osmux.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=10059): Process ended prematurely: osmo-stp_10.42.42.5(pid=10059) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10059)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10073): Process ended prematurely: osmo-stp_10.42.42.5(pid=10073) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10073)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10084): Process ended prematurely: osmo-stp_10.42.42.5(pid=10084) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10084)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10100): Process ended prematurely: osmo-stp_10.42.42.5(pid=10100) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10100)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10111): Process ended prematurely: osmo-stp_10.42.42.5(pid=10111) [trial-2360↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10111)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10125): Process ended prematurely: osmo-stp_10.42.42.5(pid=10125) [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10125)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10136): Process ended prematurely: osmo-stp_10.42.42.5(pid=10136) [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10136)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10150): Process ended prematurely: osmo-stp_10.42.42.5(pid=10150) [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10150)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10161): Process ended prematurely: osmo-stp_10.42.42.5(pid=10161) [trial-2360↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10161)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10175): Process ended prematurely: osmo-stp_10.42.42.5(pid=10175) [trial-2360↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10175)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10189): Process ended prematurely: osmo-stp_10.42.42.5(pid=10189) [trial-2360↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10189)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10203): Process ended prematurely: osmo-stp_10.42.42.5(pid=10203) [trial-2360↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10203)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10214): Process ended prematurely: osmo-stp_10.42.42.5(pid=10214) [trial-2360↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10214)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=10235): Process ended prematurely: osmo-stp_10.42.42.5(pid=10235) [trial-2360↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10235)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=10247): Process ended prematurely: osmo-stp_10.42.42.5(pid=10247) [trial-2360↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10247)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=10265): Process ended prematurely: osmo-stp_10.42.42.5(pid=10265) [trial-2360↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10265)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10275): Process ended prematurely: osmo-stp_10.42.42.5(pid=10275) [trial-2360↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10275)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10285): Process ended prematurely: osmo-stp_10.42.42.5(pid=10285) [trial-2360↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10285)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=10304): Process ended prematurely: osmo-stp_10.42.42.5(pid=10304) [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10304)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=10316): Process ended prematurely: osmo-stp_10.42.42.5(pid=10316) [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10316)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=10334): Process ended prematurely: osmo-stp_10.42.42.5(pid=10334) [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10334)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10344): Process ended prematurely: osmo-stp_10.42.42.5(pid=10344) [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10344)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10354): Process ended prematurely: osmo-stp_10.42.42.5(pid=10354) [trial-2360↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10354)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=10374): Process ended prematurely: osmo-stp_10.42.42.5(pid=10374) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10374)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=10386): Process ended prematurely: osmo-stp_10.42.42.5(pid=10386) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10386)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=10404): Process ended prematurely: osmo-stp_10.42.42.5(pid=10404) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10404)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10414): Process ended prematurely: osmo-stp_10.42.42.5(pid=10414) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10414)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10424): Process ended prematurely: osmo-stp_10.42.42.5(pid=10424) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10424)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=10442): Process ended prematurely: osmo-stp_10.42.42.5(pid=10442) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10442)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=10454): Process ended prematurely: osmo-stp_10.42.42.5(pid=10454) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10454)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=10472): Process ended prematurely: osmo-stp_10.42.42.5(pid=10472) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10472)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10482): Process ended prematurely: osmo-stp_10.42.42.5(pid=10482) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10482)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10492): Process ended prematurely: osmo-stp_10.42.42.5(pid=10492) [trial-2360↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10492)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=10509): Process ended prematurely: osmo-stp_10.42.42.5(pid=10509) [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10509)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=10521): Process ended prematurely: osmo-stp_10.42.42.5(pid=10521) [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10521)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=10542): Process ended prematurely: osmo-stp_10.42.42.5(pid=10542) [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10542)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10552): Process ended prematurely: osmo-stp_10.42.42.5(pid=10552) [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10552)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10562): Process ended prematurely: osmo-stp_10.42.42.5(pid=10562) [trial-2360↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10562)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10576): Process ended prematurely: osmo-stp_10.42.42.5(pid=10576) [trial-2360↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10576)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10589): Process ended prematurely: osmo-stp_10.42.42.5(pid=10589) [trial-2360↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10589)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=10597): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10597) [trial-2360↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10597)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10608): Process ended prematurely: osmo-stp_10.42.42.5(pid=10608) [trial-2360↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10608)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=10617): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10617) [trial-2360↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10617)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10628): Process ended prematurely: osmo-stp_10.42.42.5(pid=10628) [trial-2360↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10628)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10642): Process ended prematurely: osmo-stp_10.42.42.5(pid=10642) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10642)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10654): Process ended prematurely: osmo-stp_10.42.42.5(pid=10654) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10654)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10668): Process ended prematurely: osmo-stp_10.42.42.5(pid=10668) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10668)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10679): Process ended prematurely: osmo-stp_10.42.42.5(pid=10679) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10679)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10694): Process ended prematurely: osmo-stp_10.42.42.5(pid=10694) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10694)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10705): Process ended prematurely: osmo-stp_10.42.42.5(pid=10705) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10705)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10719): Process ended prematurely: osmo-stp_10.42.42.5(pid=10719) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10719)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10730): Process ended prematurely: osmo-stp_10.42.42.5(pid=10730) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10730)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10745): Process ended prematurely: osmo-stp_10.42.42.5(pid=10745) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10745)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10756): Process ended prematurely: osmo-stp_10.42.42.5(pid=10756) [trial-2360↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10756)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10770): Process ended prematurely: osmo-stp_10.42.42.5(pid=10770) [trial-2360↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10770)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=10781): Process ended prematurely: osmo-stp_10.42.42.5(pid=10781) [trial-2360↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10781)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10795): Process ended prematurely: osmo-stp_10.42.42.5(pid=10795) [trial-2360↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10795)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10806): Process ended prematurely: osmo-stp_10.42.42.5(pid=10806) [trial-2360↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10806)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10820): Process ended prematurely: osmo-stp_10.42.42.5(pid=10820) [trial-2360↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10820)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10831): Process ended prematurely: osmo-stp_10.42.42.5(pid=10831) [trial-2360↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10831)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=10849): Process ended prematurely: osmo-stp_10.42.42.5(pid=10849) [trial-2360↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10849)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=10861): Process ended prematurely: osmo-stp_10.42.42.5(pid=10861) [trial-2360↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10861)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=10882): Process ended prematurely: osmo-stp_10.42.42.5(pid=10882) [trial-2360↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10882)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10899): Process ended prematurely: osmo-stp_10.42.42.5(pid=10899) [trial-2360↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10899)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10921): Process ended prematurely: osmo-stp_10.42.42.5(pid=10921) [trial-2360↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10921)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=10938): Process ended prematurely: osmo-stp_10.42.42.5(pid=10938) [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10938)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=10950): Process ended prematurely: osmo-stp_10.42.42.5(pid=10950) [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10950)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=10969): Process ended prematurely: osmo-stp_10.42.42.5(pid=10969) [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10969)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10979): Process ended prematurely: osmo-stp_10.42.42.5(pid=10979) [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10979)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10989): Process ended prematurely: osmo-stp_10.42.42.5(pid=10989) [trial-2360↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10989)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=11008): Process ended prematurely: osmo-stp_10.42.42.5(pid=11008) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11008)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=11039): Process ended prematurely: osmo-stp_10.42.42.5(pid=11039) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11039)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=11058): Process ended prematurely: osmo-stp_10.42.42.5(pid=11058) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11058)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11068): Process ended prematurely: osmo-stp_10.42.42.5(pid=11068) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11068)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11078): Process ended prematurely: osmo-stp_10.42.42.5(pid=11078) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11078)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=11097): Process ended prematurely: osmo-stp_10.42.42.5(pid=11097) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11097)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=11109): Process ended prematurely: osmo-stp_10.42.42.5(pid=11109) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11109)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=11127): Process ended prematurely: osmo-stp_10.42.42.5(pid=11127) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11127)] FAIL: ping.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=11409): Process ended prematurely: osmo-stp_10.42.42.5(pid=11409) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11409)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11419): Process ended prematurely: osmo-stp_10.42.42.5(pid=11419) [trial-2360↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11419)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11432): Process ended prematurely: osmo-stp_10.42.42.5(pid=11432) [trial-2360↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11432)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11446): Process ended prematurely: osmo-stp_10.42.42.5(pid=11446) [trial-2360↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11446)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=11455): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11455) [trial-2360↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11455)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=11465): Process ended prematurely: osmo-stp_10.42.42.5(pid=11465) [trial-2360↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11465)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=11474): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11474) [trial-2360↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11474)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11485): Process ended prematurely: osmo-stp_10.42.42.5(pid=11485) [trial-2360↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11485)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11499): Process ended prematurely: osmo-stp_10.42.42.5(pid=11499) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11499)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11510): Process ended prematurely: osmo-stp_10.42.42.5(pid=11510) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11510)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11524): Process ended prematurely: osmo-stp_10.42.42.5(pid=11524) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11524)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11545): Process ended prematurely: osmo-stp_10.42.42.5(pid=11545) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11545)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11807): Process ended prematurely: osmo-stp_10.42.42.5(pid=11807) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11807)] FAIL: mo_mt_call_osmux.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=12097): Process ended prematurely: osmo-stp_10.42.42.5(pid=12097) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12097)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12112): Process ended prematurely: osmo-stp_10.42.42.5(pid=12112) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12112)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12123): Process ended prematurely: osmo-stp_10.42.42.5(pid=12123) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12123)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12137): Process ended prematurely: osmo-stp_10.42.42.5(pid=12137) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12137)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12148): Process ended prematurely: osmo-stp_10.42.42.5(pid=12148) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12148)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12162): Process ended prematurely: osmo-stp_10.42.42.5(pid=12162) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12162)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12173): Process ended prematurely: osmo-stp_10.42.42.5(pid=12173) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12173)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12188): Process ended prematurely: osmo-stp_10.42.42.5(pid=12188) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12188)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12199): Process ended prematurely: osmo-stp_10.42.42.5(pid=12199) [trial-2360↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12199)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12214): Process ended prematurely: osmo-stp_10.42.42.5(pid=12214) [trial-2360↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12214)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12225): Process ended prematurely: osmo-stp_10.42.42.5(pid=12225) [trial-2360↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12225)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=12243): Process ended prematurely: osmo-stp_10.42.42.5(pid=12243) [trial-2360↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12243)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=12256): Process ended prematurely: osmo-stp_10.42.42.5(pid=12256) [trial-2360↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12256)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=12274): Process ended prematurely: osmo-stp_10.42.42.5(pid=12274) [trial-2360↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12274)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12284): Process ended prematurely: osmo-stp_10.42.42.5(pid=12284) [trial-2360↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12284)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12294): Process ended prematurely: osmo-stp_10.42.42.5(pid=12294) [trial-2360↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12294)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=12312): Process ended prematurely: osmo-stp_10.42.42.5(pid=12312) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12312)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=12324): Process ended prematurely: osmo-stp_10.42.42.5(pid=12324) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12324)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=12342): Process ended prematurely: osmo-stp_10.42.42.5(pid=12342) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12342)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12352): Process ended prematurely: osmo-stp_10.42.42.5(pid=12352) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12352)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12362): Process ended prematurely: osmo-stp_10.42.42.5(pid=12362) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12362)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=12379): Process ended prematurely: osmo-stp_10.42.42.5(pid=12379) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12379)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=12391): Process ended prematurely: osmo-stp_10.42.42.5(pid=12391) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12391)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=12410): Process ended prematurely: osmo-stp_10.42.42.5(pid=12410) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12410)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12424): Process ended prematurely: osmo-stp_10.42.42.5(pid=12424) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12424)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12434): Process ended prematurely: osmo-stp_10.42.42.5(pid=12434) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12434)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=12452): Process ended prematurely: osmo-stp_10.42.42.5(pid=12452) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12452)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=12464): Process ended prematurely: osmo-stp_10.42.42.5(pid=12464) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12464)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=12482): Process ended prematurely: osmo-stp_10.42.42.5(pid=12482) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12482)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12492): Process ended prematurely: osmo-stp_10.42.42.5(pid=12492) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12492)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12502): Process ended prematurely: osmo-stp_10.42.42.5(pid=12502) [trial-2360↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12502)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12515): Process ended prematurely: osmo-stp_10.42.42.5(pid=12515) [trial-2360↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12515)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12528): Process ended prematurely: osmo-stp_10.42.42.5(pid=12528) [trial-2360↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12528)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=12536): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12536) [trial-2360↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12536)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12546): Process ended prematurely: osmo-stp_10.42.42.5(pid=12546) [trial-2360↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12546)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=12555): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12555) [trial-2360↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12555)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12565): Process ended prematurely: osmo-stp_10.42.42.5(pid=12565) [trial-2360↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12565)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12579): Process ended prematurely: osmo-stp_10.42.42.5(pid=12579) [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12579)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12591): Process ended prematurely: osmo-stp_10.42.42.5(pid=12591) [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12591)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12605): Process ended prematurely: osmo-stp_10.42.42.5(pid=12605) [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12605)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12616): Process ended prematurely: osmo-stp_10.42.42.5(pid=12616) [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12616)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12630): Process ended prematurely: osmo-stp_10.42.42.5(pid=12630) [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12630)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12641): Process ended prematurely: osmo-stp_10.42.42.5(pid=12641) [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12641)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12656): Process ended prematurely: osmo-stp_10.42.42.5(pid=12656) [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12656)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12668): Process ended prematurely: osmo-stp_10.42.42.5(pid=12668) [trial-2360↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12668)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12682): Process ended prematurely: osmo-stp_10.42.42.5(pid=12682) [trial-2360↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12682)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12693): Process ended prematurely: osmo-stp_10.42.42.5(pid=12693) [trial-2360↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12693)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12707): Process ended prematurely: osmo-stp_10.42.42.5(pid=12707) [trial-2360↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12707)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12718): Process ended prematurely: osmo-stp_10.42.42.5(pid=12718) [trial-2360↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12718)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=12738): Process ended prematurely: osmo-stp_10.42.42.5(pid=12738) [trial-2360↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12738)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=12750): Process ended prematurely: osmo-stp_10.42.42.5(pid=12750) [trial-2360↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12750)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=12771): Process ended prematurely: osmo-stp_10.42.42.5(pid=12771) [trial-2360↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12771)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12781): Process ended prematurely: osmo-stp_10.42.42.5(pid=12781) [trial-2360↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12781)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12791): Process ended prematurely: osmo-stp_10.42.42.5(pid=12791) [trial-2360↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12791)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=12808): Process ended prematurely: osmo-stp_10.42.42.5(pid=12808) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12808)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=12820): Process ended prematurely: osmo-stp_10.42.42.5(pid=12820) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12820)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=12838): Process ended prematurely: osmo-stp_10.42.42.5(pid=12838) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12838)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12849): Process ended prematurely: osmo-stp_10.42.42.5(pid=12849) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12849)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12859): Process ended prematurely: osmo-stp_10.42.42.5(pid=12859) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12859)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=12878): Process ended prematurely: osmo-stp_10.42.42.5(pid=12878) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12878)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=12890): Process ended prematurely: osmo-stp_10.42.42.5(pid=12890) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12890)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=12908): Process ended prematurely: osmo-stp_10.42.42.5(pid=12908) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12908)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12918): Process ended prematurely: osmo-stp_10.42.42.5(pid=12918) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12918)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12928): Process ended prematurely: osmo-stp_10.42.42.5(pid=12928) [trial-2360↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12928)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12942): Process ended prematurely: osmo-stp_10.42.42.5(pid=12942) [trial-2360↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12942)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12955): Process ended prematurely: osmo-stp_10.42.42.5(pid=12955) [trial-2360↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12955)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=12965): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12965) [trial-2360↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12965)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=13071): Process ended prematurely: osmo-stp_10.42.42.5(pid=13071) [trial-2360↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13071)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=13260): Process ended prematurely: osmo-stp_10.42.42.5(pid=13260) [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13260)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13271): Process ended prematurely: osmo-stp_10.42.42.5(pid=13271) [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13271)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13285): Process ended prematurely: osmo-stp_10.42.42.5(pid=13285) [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13285)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13297): Process ended prematurely: osmo-stp_10.42.42.5(pid=13297) [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13297)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13311): Process ended prematurely: osmo-stp_10.42.42.5(pid=13311) [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13311)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13322): Process ended prematurely: osmo-stp_10.42.42.5(pid=13322) [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13322)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13337): Process ended prematurely: osmo-stp_10.42.42.5(pid=13337) [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13337)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13348): Process ended prematurely: osmo-stp_10.42.42.5(pid=13348) [trial-2360↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13348)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13362): Process ended prematurely: osmo-stp_10.42.42.5(pid=13362) [trial-2360↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13362)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13373): Process ended prematurely: osmo-stp_10.42.42.5(pid=13373) [trial-2360↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13373)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13388): Process ended prematurely: osmo-stp_10.42.42.5(pid=13388) [trial-2360↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13388)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13402): Process ended prematurely: osmo-stp_10.42.42.5(pid=13402) [trial-2360↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13402)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13416): Process ended prematurely: osmo-stp_10.42.42.5(pid=13416) [trial-2360↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13416)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13427): Process ended prematurely: osmo-stp_10.42.42.5(pid=13427) [trial-2360↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13427)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=13445): Process ended prematurely: osmo-stp_10.42.42.5(pid=13445) [trial-2360↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13445)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=13457): Process ended prematurely: osmo-stp_10.42.42.5(pid=13457) [trial-2360↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13457)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=13475): Process ended prematurely: osmo-stp_10.42.42.5(pid=13475) [trial-2360↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13475)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13485): Process ended prematurely: osmo-stp_10.42.42.5(pid=13485) [trial-2360↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13485)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13495): Process ended prematurely: osmo-stp_10.42.42.5(pid=13495) [trial-2360↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13495)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=13513): Process ended prematurely: osmo-stp_10.42.42.5(pid=13513) [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13513)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=13525): Process ended prematurely: osmo-stp_10.42.42.5(pid=13525) [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13525)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=13543): Process ended prematurely: osmo-stp_10.42.42.5(pid=13543) [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13543)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13556): Process ended prematurely: osmo-stp_10.42.42.5(pid=13556) [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13556)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13566): Process ended prematurely: osmo-stp_10.42.42.5(pid=13566) [trial-2360↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13566)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=13583): Process ended prematurely: osmo-stp_10.42.42.5(pid=13583) [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13583)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=13595): Process ended prematurely: osmo-stp_10.42.42.5(pid=13595) [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13595)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=13613): Process ended prematurely: osmo-stp_10.42.42.5(pid=13613) [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13613)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13624): Process ended prematurely: osmo-stp_10.42.42.5(pid=13624) [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13624)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13634): Process ended prematurely: osmo-stp_10.42.42.5(pid=13634) [trial-2360↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13634)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=13652): Process ended prematurely: osmo-stp_10.42.42.5(pid=13652) [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13652)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=13665): Process ended prematurely: osmo-stp_10.42.42.5(pid=13665) [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13665)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=13683): Process ended prematurely: osmo-stp_10.42.42.5(pid=13683) [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13683)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13693): Process ended prematurely: osmo-stp_10.42.42.5(pid=13693) [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13693)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13703): Process ended prematurely: osmo-stp_10.42.42.5(pid=13703) [trial-2360↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13703)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13716): Process ended prematurely: osmo-stp_10.42.42.5(pid=13716) [trial-2360↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13716)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=13724): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13724) [trial-2360↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13724)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=13726): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13726) [trial-2360↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13726)] FAIL: esme_ms_sms_storeforward.py (2.7 sec) Error: osmo-nitb_10.42.42.2(pid=13728): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13728) [trial-2360↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13728)] FAIL: esme_ms_sms_transaction.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=13740): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13740) [trial-2360↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13740)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.3 sec) Error: osmo-hlr_10.42.42.2(pid=13749): Process ended prematurely: osmo-hlr_10.42.42.2(pid=13749) [trial-2360↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13749)] FAIL: esme_connect_policy_closed.py (6.2 sec) Error: osmo-hlr_10.42.42.2(pid=14111): Process ended prematurely: osmo-hlr_10.42.42.2(pid=14111) [trial-2360↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14111)] FAIL: esme_ms_sms_storeforward.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=14298): Process ended prematurely: osmo-stp_10.42.42.5(pid=14298) [trial-2360↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14298)] FAIL: esme_ms_sms_transaction.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14310): Process ended prematurely: osmo-stp_10.42.42.5(pid=14310) [trial-2360↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14310)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14324): Process ended prematurely: osmo-stp_10.42.42.5(pid=14324) [trial-2360↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14324)] FAIL: register_a5_0_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14335): Process ended prematurely: osmo-stp_10.42.42.5(pid=14335) [trial-2360↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14335)] FAIL: register_a5_1_authreq.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14346): Process ended prematurely: osmo-stp_10.42.42.5(pid=14346) [trial-2360↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14346)] FAIL: register_a5_3_authreq.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14357): Process ended prematurely: osmo-stp_10.42.42.5(pid=14357) [trial-2360↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14357)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.9 sec) Error: srsepc(pid=14378): Process ended prematurely: srsepc(pid=14378) [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14378)] FAIL: iperf3_bidir.py (18.8 sec) Error: srsepc(pid=14394): Process ended prematurely: srsepc(pid=14394) [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14394)] FAIL: iperf3_dl.py (18.8 sec) Error: srsepc(pid=14410): Process ended prematurely: srsepc(pid=14410) [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14410)] FAIL: iperf3_ul.py (18.7 sec) Error: srsepc(pid=14426): Process ended prematurely: srsepc(pid=14426) [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14426)] FAIL: ping.py (18.3 sec) Error: srsepc(pid=14444): Process ended prematurely: srsepc(pid=14444) [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14444)] FAIL: rrc_idle_mo_ping.py (18.1 sec) Error: srsepc(pid=14461): Process ended prematurely: srsepc(pid=14461) [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14461)] FAIL: rrc_idle_mt_ping.py (18.4 sec) Error: srsepc(pid=14477): Process ended prematurely: srsepc(pid=14477) [trial-2360↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=14477)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14490): Process ended prematurely: osmo-stp_10.42.42.5(pid=14490) [trial-2360↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14490)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14504): Process ended prematurely: osmo-stp_10.42.42.5(pid=14504) [trial-2360↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14504)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=14520): Process ended prematurely: osmo-stp_10.42.42.5(pid=14520) [trial-2360↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14520)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14535): Process ended prematurely: osmo-stp_10.42.42.5(pid=14535) [trial-2360↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14535)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14549): Process ended prematurely: osmo-stp_10.42.42.5(pid=14549) [trial-2360↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14549)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14563): Process ended prematurely: osmo-stp_10.42.42.5(pid=14563) [trial-2360↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14563)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14577): Process ended prematurely: osmo-stp_10.42.42.5(pid=14577) [trial-2360↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14577)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14591): Process ended prematurely: osmo-stp_10.42.42.5(pid=14591) [trial-2360↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14591)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14615): Process ended prematurely: osmo-stp_10.42.42.5(pid=14615) [trial-2360↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14615)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14980): Process ended prematurely: osmo-stp_10.42.42.5(pid=14980) [trial-2360↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14980)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15170): Process ended prematurely: osmo-stp_10.42.42.5(pid=15170) [trial-2360↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15170)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15185): Process ended prematurely: osmo-stp_10.42.42.5(pid=15185) [trial-2360↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15185)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15200): Process ended prematurely: osmo-stp_10.42.42.5(pid=15200) [trial-2360↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15200)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15214): Process ended prematurely: osmo-stp_10.42.42.5(pid=15214) [trial-2360↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15214)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15228): Process ended prematurely: osmo-stp_10.42.42.5(pid=15228) [trial-2360↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15228)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15242): Process ended prematurely: osmo-stp_10.42.42.5(pid=15242) [trial-2360↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15242)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15256): Process ended prematurely: osmo-stp_10.42.42.5(pid=15256) [trial-2360↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15256)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15270): Process ended prematurely: osmo-stp_10.42.42.5(pid=15270) [trial-2360↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15270)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15284): Process ended prematurely: osmo-stp_10.42.42.5(pid=15284) [trial-2360↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15284)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15298): Process ended prematurely: osmo-stp_10.42.42.5(pid=15298) [trial-2360↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15298)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15312): Process ended prematurely: osmo-stp_10.42.42.5(pid=15312) [trial-2360↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15312)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15327): Process ended prematurely: osmo-stp_10.42.42.5(pid=15327) [trial-2360↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15327)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15341): Process ended prematurely: osmo-stp_10.42.42.5(pid=15341) [trial-2360↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15341)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=15483): Process ended prematurely: osmo-stp_10.42.42.5(pid=15483) [trial-2360↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15483)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=15641): Process ended prematurely: osmo-stp_10.42.42.5(pid=15641) [trial-2360↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15641)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15655): Process ended prematurely: osmo-stp_10.42.42.5(pid=15655) [trial-2360↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15655)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15669): Process ended prematurely: osmo-stp_10.42.42.5(pid=15669) [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15669)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15683): Process ended prematurely: osmo-stp_10.42.42.5(pid=15683) [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15683)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15697): Process ended prematurely: osmo-stp_10.42.42.5(pid=15697) [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15697)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=15712): Process ended prematurely: osmo-stp_10.42.42.5(pid=15712) [trial-2360↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15712)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15726): Process ended prematurely: osmo-stp_10.42.42.5(pid=15726) [trial-2360↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15726)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15740): Process ended prematurely: osmo-stp_10.42.42.5(pid=15740) [trial-2360↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15740)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15754): Process ended prematurely: osmo-stp_10.42.42.5(pid=15754) [trial-2360↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15754)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=15772): Process ended prematurely: osmo-stp_10.42.42.5(pid=15772) [trial-2360↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15772)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15786): Process ended prematurely: osmo-stp_10.42.42.5(pid=15786) [trial-2360↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15786)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15800): Process ended prematurely: osmo-stp_10.42.42.5(pid=15800) [trial-2360↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15800)] + rm -rf trial-2360/inst + cd trial-2360 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-09 12:45:46 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360-run.tgz run.2022-12-09_12-45-57 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2360-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17653.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6678.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2948.tgz osmo-mgw.build-8943.tgz osmo-msc.build-29260.tgz osmo-nitb.build-12965.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30036.tgz osmo-stp.build-9238.tgz osmo-trx.build-4674.tgz osmocom-bb.build-4696.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE